-- Logs begin at Sun 2022-09-11 04:50:15 UTC, end at Sun 2022-09-11 06:22:08 UTC. -- Sep 11 05:21:12.982131 dv-cinder-856921-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 05:21:12.991515 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 05:21:12 2022] *** Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: nodename: dv-cinder-856921-1-iscsi Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: machine: x86_64 Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: clock source: unix Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: pcre jit disabled Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: detected number of CPU cores: 4 Sep 11 05:21:12.993498 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: current working directory: / Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: detected binary path: /usr/bin/uwsgi-core Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: your processes number limit is 47680 Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: your memory page size is 4096 bytes Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: detected max file descriptor number: 2048 Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: lock engine: pthread robust mutexes Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: thunder lock: enabled Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 05:21:12.994112 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 05:21:13.033049 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: Python main interpreter initialized at 0x563d2d2019c0 Sep 11 05:21:13.033049 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: python threads support enabled Sep 11 05:21:13.033049 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: your server socket listen backlog is limited to 100 connections Sep 11 05:21:13.033049 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: your mercy for graceful operations on workers is 90 seconds Sep 11 05:21:13.033416 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 05:21:13.033499 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: *** Operational MODE: preforking *** Sep 11 05:21:13.033701 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: *** uWSGI is running in multiple interpreter mode *** Sep 11 05:21:13.033701 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: spawned uWSGI master process (pid: 105457) Sep 11 05:21:13.033888 dv-cinder-856921-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 05:21:13.034838 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: spawned uWSGI worker 1 (pid: 105458, cores: 1) Sep 11 05:21:13.034838 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: spawned uWSGI worker 2 (pid: 105459, cores: 1) Sep 11 05:21:13.034838 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 05:21:13.693577 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 05:21:13.703338 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 05:21:14.790260 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:21:14.790260 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: from cryptography.utils import int_from_bytes Sep 11 05:21:14.790836 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:21:14.790836 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: from cryptography.utils import int_from_bytes Sep 11 05:21:14.793558 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:21:14.793558 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: from cryptography.utils import int_from_bytes Sep 11 05:21:14.794026 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:21:14.794026 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: from cryptography.utils import int_from_bytes Sep 11 05:21:17.292056 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:21:17.292624 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:21:17.292836 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:21:17.293199 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:21:17.293455 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:21:17.293838 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.294162 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.294483 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.294609 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:21:17.294989 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.295084 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:21:17.295172 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.295371 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:21:17.295476 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.295712 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.295812 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:21:17.295983 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:21:17.296092 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.296361 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.296450 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.296621 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.296705 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.296937 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297044 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297259 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856921-1-iscsi {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297356 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297580 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297668 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297885 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.297983 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298202 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298289 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298531 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298671 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298818 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.298915 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299095 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299190 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299410 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299497 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299737 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856921-1-iscsi {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.299908 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300083 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300367 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300492 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300671 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300789 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.300981 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301096 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301287 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301418 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301615 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301706 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.301919 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302014 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302231 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302422 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302534 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302732 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.302827 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303037 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303126 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303345 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303517 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856921-1-iscsi {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303681 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.303829 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304013 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304165 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304325 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304479 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304644 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304891 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.304988 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305201 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305288 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305507 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305601 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305829 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.305936 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856921-1-iscsi {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.306148 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.306251 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.306448 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.306560 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.307316 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.307424 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.307641 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.307770 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.307958 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308109 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308306 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308420 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308613 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308752 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.308921 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309050 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309226 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309358 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309545 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309686 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.309851 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310006 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310156 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310325 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310490 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310645 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310734 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.310945 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311045 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311253 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311343 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311562 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311657 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311855 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.311943 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312139 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312272 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312457 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312579 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312777 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.312876 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313083 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313172 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313389 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313483 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313693 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313791 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.313999 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314086 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314287 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314374 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314540 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314632 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314857 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.314951 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315177 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315265 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315486 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315575 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315793 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.315943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316126 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316228 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316434 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316524 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316738 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.316835 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317044 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317145 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317350 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317440 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317659 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317753 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.317975 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318075 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318291 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318386 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318601 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318688 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.318908 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319008 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319223 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319309 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319527 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319614 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319830 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.319932 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320167 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320257 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320488 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320586 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320814 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.320902 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321114 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321200 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321362 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321457 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321659 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321756 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.321959 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.322054 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.322293 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.322930 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323115 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323265 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323454 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323544 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323714 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.323884 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324051 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324215 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324436 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324524 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324749 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.324839 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325054 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325144 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325358 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325446 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325661 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325763 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.325964 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326052 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326264 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326350 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326563 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326658 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326863 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.326950 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327164 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327251 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327469 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327574 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327774 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.327864 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328098 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328190 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328403 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328501 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328706 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.328803 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329005 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329099 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329307 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329402 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329610 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329698 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.329908 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330006 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330225 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330321 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330526 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330663 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330826 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.330914 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331129 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331230 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331431 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331526 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331735 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.331824 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332072 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332185 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332372 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332477 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332676 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332768 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.332982 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333070 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333282 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333376 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333584 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333679 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333885 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.333974 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334183 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334271 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334481 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334577 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334781 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.334870 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335079 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335166 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335379 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335475 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335673 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335762 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.335977 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336135 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336301 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336408 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336605 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336701 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336906 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.336992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337207 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337304 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337508 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337594 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337810 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.337940 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.338137 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.338350 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.338444 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.338534 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.338752 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.338847 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.339060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.339161 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.339366 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.339454 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.339668 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.339768 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.339986 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:21:17.340115 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.340346 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.340447 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.340668 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.340802 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.340977 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341066 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341284 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341380 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341592 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341680 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341904 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.341993 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342219 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342307 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342547 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342645 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342859 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.342946 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343171 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343278 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343482 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343571 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343788 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.343883 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344127 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344219 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344444 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344545 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344762 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.344852 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345070 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345166 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345393 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345557 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345708 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.345798 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346023 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346113 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346332 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346433 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346649 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346738 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.346956 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347051 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347265 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347362 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347573 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347662 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.347946 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348064 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348255 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348358 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348570 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348667 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348887 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.348975 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349198 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349288 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349508 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349602 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349818 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.349907 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350125 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350216 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350435 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350523 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350745 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.350871 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351055 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351145 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351372 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351467 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351683 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.351772 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352019 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352111 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352333 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352432 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352642 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352739 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.352949 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353036 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353258 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353353 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353606 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353801 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.353947 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354050 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354212 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354319 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354511 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354613 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354812 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.354901 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355122 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355214 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355425 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355531 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.355831 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356106 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356198 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356413 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356520 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356744 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.356832 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357139 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357359 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357455 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357667 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357754 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.357971 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358058 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358273 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358361 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358587 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358713 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358896 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.358984 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359196 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359323 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359516 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359604 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359822 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.359909 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360149 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360242 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360470 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360561 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360774 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.360872 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361174 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361389 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361477 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361699 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.361794 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362005 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362100 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362315 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362403 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362622 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362725 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.362943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363032 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363247 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363334 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363552 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363643 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363865 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.363952 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364203 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364291 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364518 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364614 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364832 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.364921 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365144 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365454 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365550 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365756 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.365845 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366063 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366152 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366363 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366452 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366663 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366751 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.366962 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367058 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367265 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367355 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367563 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367652 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367865 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.367962 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368192 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368282 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368499 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368589 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368798 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.368901 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.369116 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.369752 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370035 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370134 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370334 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370433 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370636 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370726 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.370936 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371021 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371244 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371349 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371546 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371635 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371849 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.371938 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372195 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372294 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372510 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372600 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372813 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.372912 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373120 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373211 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373422 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373512 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373735 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.373823 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374046 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374143 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374354 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374443 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374662 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374750 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.374979 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375069 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375288 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375384 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375602 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375700 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.375910 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376019 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376244 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376332 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376551 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376650 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376858 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.376946 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377158 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377244 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377469 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377568 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377776 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.377874 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378093 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378189 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378405 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378503 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378725 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.378812 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379031 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379117 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379341 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379430 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379643 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379737 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.379949 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.380090 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.380536 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.380628 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.380844 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.380933 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381160 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381248 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381469 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381568 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381782 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.381878 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382089 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382177 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382401 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382489 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382705 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.382792 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383014 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383102 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383312 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383401 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383625 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383714 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.383933 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.384075 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.384276 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.384365 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.384585 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.384681 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.385533 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.385642 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.385913 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386000 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386236 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386338 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386544 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386689 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386860 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.386950 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387189 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387277 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387492 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387593 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387802 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.387893 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388145 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388236 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388456 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388546 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388766 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.388855 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389075 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389169 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389385 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389482 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389689 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389776 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.389994 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390095 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390294 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390392 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390604 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390705 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.390914 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391002 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391219 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391315 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391522 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391609 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391837 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.391933 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392164 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392253 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392466 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392553 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392768 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.392870 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393080 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393168 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393381 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393506 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393684 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393789 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.393986 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394082 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394316 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394402 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394620 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394717 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.394920 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395007 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395321 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395539 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395691 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395844 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.395944 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396174 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396303 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396482 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396579 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396787 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.396935 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397106 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397249 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397396 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397533 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397714 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.397865 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398011 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398151 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398317 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398453 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398625 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398759 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.398933 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399067 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399241 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399377 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399547 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399694 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.399853 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400043 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400179 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400316 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400506 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400667 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.400956 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401110 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401273 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401421 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401674 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401839 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.401998 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402184 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402310 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402484 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402620 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402804 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.402932 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403145 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403256 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403461 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403551 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403791 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.403888 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.404142 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.404420 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.404511 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.404747 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.404836 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405056 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405154 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405359 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405448 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405661 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405750 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.405971 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406069 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406271 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406362 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406574 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406679 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406876 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.406965 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407184 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407274 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407483 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407574 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407786 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.407885 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408116 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408208 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408420 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408536 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408725 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.408819 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409030 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409120 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409336 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409425 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409636 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409730 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.409937 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410026 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410242 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410331 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410540 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410636 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410842 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.410937 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411141 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411228 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411446 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411542 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411757 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.411846 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412082 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412174 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412408 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412508 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412719 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.412817 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413031 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413120 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413334 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413423 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413636 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413723 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.413945 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414043 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414247 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414337 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414548 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414643 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414857 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.414953 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415163 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415252 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415463 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415559 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415770 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.415859 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.416221 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.416584 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.416768 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.416910 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417081 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417227 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417389 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417535 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417703 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.417847 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418013 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418154 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418320 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418471 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418633 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418783 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.418942 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419087 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419252 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419398 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419563 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419709 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.419868 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420036 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420204 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420336 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420510 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420641 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420828 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.420944 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421139 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421259 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421444 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421565 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421749 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.421869 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422062 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422158 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422372 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422469 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422675 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422765 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.422984 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423073 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423294 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423382 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423609 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423699 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.423914 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424040 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424261 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424363 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424564 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424653 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424876 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.424964 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425185 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425290 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425488 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425586 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425813 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.425939 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426124 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426222 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426429 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426735 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.426876 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427044 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427190 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427350 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427488 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427654 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427792 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.427963 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428127 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428277 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428414 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428585 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428721 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.428903 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429042 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429177 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429314 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429471 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429609 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429788 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.429925 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430091 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430241 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430378 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430523 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430674 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430821 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.430958 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.431095 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.431273 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.431419 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.431577 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.432277 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.432487 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.432816 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.432905 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433129 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433228 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433434 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433523 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433747 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.433845 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434052 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434142 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434389 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434485 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434693 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.434781 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435003 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435092 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435321 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435408 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435634 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435722 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.435950 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436071 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436282 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436372 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436588 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436764 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436902 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.436997 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437210 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437300 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437520 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437615 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437828 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.437916 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438145 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438280 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438452 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438551 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438755 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.438842 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439065 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439152 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439375 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439472 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439680 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.439767 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440023 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440115 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440324 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440414 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440631 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440723 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.440940 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441030 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441248 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441354 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441554 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441644 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441861 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.441948 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442163 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442259 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442471 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442560 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442779 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.442873 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443079 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443167 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443387 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443475 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443698 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.443865 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444018 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444121 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444327 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444628 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444724 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.444934 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445035 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445232 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445327 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445553 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445648 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445863 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.445951 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446169 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446265 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446478 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446575 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446783 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.446873 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447093 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447484 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447589 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447797 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.447887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448138 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448236 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448530 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448620 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448838 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.448926 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449147 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449234 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449456 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449546 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449759 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.449856 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450067 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450156 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450371 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450458 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450691 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450795 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.450993 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451091 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451296 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451385 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451599 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451686 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.451920 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452069 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452252 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452340 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452573 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452661 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452896 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.452995 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453200 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453288 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453510 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453606 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453814 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.453968 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454137 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454279 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454442 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454588 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454765 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.454909 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455180 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455277 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455492 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455580 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455797 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.455895 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456274 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456583 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456818 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.456956 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457139 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457235 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457446 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457549 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457757 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.457846 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458156 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458374 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458463 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458682 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458772 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.458991 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459079 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459310 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459407 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459618 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459715 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.459933 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460066 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460261 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460351 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460585 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460686 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.460908 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461013 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461223 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461314 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461542 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461640 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461852 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.461941 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462155 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462265 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462458 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462560 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462777 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.462866 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.463716 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.463804 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464047 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464177 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464357 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464497 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464669 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464807 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.464975 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465112 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465280 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465418 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465604 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.465911 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466048 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466223 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466362 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466536 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466672 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466845 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.466992 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467148 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467311 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467453 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467614 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467777 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.467937 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468106 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468433 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468573 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468747 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.468875 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469070 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469166 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469391 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469520 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469697 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.469825 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470020 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470142 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470331 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470475 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470635 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470800 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.470939 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471109 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471242 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471438 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471584 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471759 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.471889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472110 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472235 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472419 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472566 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472735 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.472895 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473056 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473205 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473357 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473539 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473657 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473868 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.473956 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474188 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474278 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474499 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474589 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474818 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.474921 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475121 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475216 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475421 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475511 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475722 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.475824 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476040 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476132 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476347 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476480 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476652 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476754 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.476956 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477046 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477265 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477362 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477567 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477670 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477867 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.477954 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.478167 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.478255 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.478488 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.478620 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.478944 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479032 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479321 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479410 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479638 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479728 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.479947 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480058 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480283 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480372 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480590 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480681 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.480914 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481002 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481232 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481320 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481548 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481644 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481859 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.481946 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482172 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482273 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482481 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482569 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482796 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.482884 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483110 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483208 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483427 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483517 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483746 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.483940 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484075 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484293 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484385 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484607 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484698 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.484920 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485008 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485232 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485330 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485545 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485634 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.485856 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486117 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486220 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486450 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486588 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486760 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.486848 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487068 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487166 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487382 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487479 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487698 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.487787 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488026 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488165 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488346 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488435 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488659 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488766 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.488970 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489058 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489279 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489368 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489590 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489686 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.489917 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490005 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490242 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490336 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490547 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490639 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490860 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.490954 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491172 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491269 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491483 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491582 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491791 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.491887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492122 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492226 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492434 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492525 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.492842 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493050 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493148 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493356 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493451 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493666 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493760 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.493976 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.494074 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.494399 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.494496 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.494749 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.494915 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495064 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495162 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495376 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495466 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495687 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.495776 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496044 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496139 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496340 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496575 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496677 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496891 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.496990 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497222 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497350 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497544 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497633 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497867 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.497975 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.498183 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.498272 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.498499 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.498709 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.498878 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499032 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499122 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499372 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499460 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499699 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.499800 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500019 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500126 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500339 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500429 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500660 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500757 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.500967 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501064 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501271 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501368 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501581 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501682 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501883 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.501979 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.502194 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.502411 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.502508 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.502756 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.502854 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503073 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503170 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503398 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503496 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503716 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.503804 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504054 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504146 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504364 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504591 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504689 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.504938 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.505033 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.505523 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.505628 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.505840 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.505929 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506151 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506240 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506453 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506552 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506760 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.506859 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507063 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507159 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507370 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507471 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507670 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507758 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.507980 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508104 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508300 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508399 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508604 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508699 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.508910 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.509011 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.509209 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.509298 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.509511 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.509601 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.510330 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.510432 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.510677 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.510986 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511146 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511310 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511456 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511617 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511765 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.511921 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512094 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512251 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512410 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512564 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512716 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.512869 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513025 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513174 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513328 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513478 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513638 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513782 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.513991 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514077 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514303 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514395 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514628 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514727 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.514928 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515018 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515336 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515533 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515623 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515847 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.515936 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516182 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516287 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516504 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516595 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516816 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.516906 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517124 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517221 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517444 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517580 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517757 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.517848 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518082 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518288 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518379 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518623 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518720 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.518946 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519056 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519278 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519367 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519609 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519854 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.519950 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520324 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520537 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520627 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520864 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.520962 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521173 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521262 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521485 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521582 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521792 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.521890 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522098 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522187 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522405 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522495 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522714 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.522812 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523022 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523120 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523330 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523420 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523636 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523733 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.523943 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524059 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524275 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524364 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524584 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524680 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524889 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.524989 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.525198 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.525287 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526055 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526158 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526368 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526460 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526679 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526767 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.526988 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527080 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527297 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527387 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527613 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527711 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.527953 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528114 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528295 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528393 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528601 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528698 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.528910 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529007 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529223 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529313 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529531 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529696 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529843 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.529934 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.530145 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.530233 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.530453 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.530767 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.530856 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531097 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531188 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531410 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531516 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531718 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.531808 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.532050 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.532376 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.532465 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.532697 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.532787 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533005 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533094 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533321 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533418 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533629 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533732 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.533955 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534288 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534386 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534606 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534696 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.534925 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535014 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535228 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535326 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535529 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535619 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535830 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.535918 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536162 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536253 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536478 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536568 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536787 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.536876 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537091 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537182 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537393 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537481 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537700 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.537789 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538001 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538091 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538302 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538399 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538602 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538692 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538904 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.538993 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539208 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539296 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539505 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539603 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539804 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.539894 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540128 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540220 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540428 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540529 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540733 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.540823 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541053 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541150 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541362 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541514 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541770 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.541878 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542131 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542242 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542387 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542496 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542700 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542907 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.542990 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543146 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543280 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543383 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543587 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543677 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543891 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.543988 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544226 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544318 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544529 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544619 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544847 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.544934 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545155 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545245 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545476 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545794 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.545891 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546106 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546196 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546410 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546498 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546736 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.546836 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547136 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547351 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547448 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547657 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547756 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.547965 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548128 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548293 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548383 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548599 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548702 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.548912 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549007 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549226 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549319 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549526 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549615 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549835 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.549922 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550145 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550461 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550550 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550778 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.550867 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551082 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551170 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551409 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551500 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551714 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.551810 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552039 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552150 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552350 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552441 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552658 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552749 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.552965 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553063 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553277 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553366 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553585 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553674 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553893 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.553994 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554204 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554292 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554511 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554600 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554826 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.554923 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555136 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555225 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555443 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555530 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555757 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.555845 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556098 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556190 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556427 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556515 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556760 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.556853 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557102 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557343 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557445 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557529 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557725 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.557816 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.558035 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.558170 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.558338 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.558554 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.558645 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:21:17.558817 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.559147 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.559461 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.559776 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.560112 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:21:17.560360 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:21:17.712625 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Registered counter for database nova_api Sep 11 05:21:17.712828 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO dbcounter [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Registered counter for database nova_api Sep 11 05:21:17.733720 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_db.sqlalchemy.engines [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.736876 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.740392 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writer thread running {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.743506 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.797866 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.context [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf3f0c85-0dae-4d22-94ea-a598ee9fea69(cell1) {{(pid=105458) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 05:21:17.800784 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.context [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf3f0c85-0dae-4d22-94ea-a598ee9fea69(cell1) {{(pid=105459) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 05:21:17.801737 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:21:17.802214 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:21:17.803820 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:21:17.804836 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:21:17.804938 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:21:17.805039 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:21:17.805135 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:21:17.806736 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:21:17.807263 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:21:17.807476 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:21:17.807936 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:21:17.809382 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO dbcounter [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Registered counter for database nova_cell0 Sep 11 05:21:17.809972 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:21:17.811959 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Registered counter for database nova_cell0 Sep 11 05:21:17.813454 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO dbcounter [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Registered counter for database nova_cell1 Sep 11 05:21:17.815983 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Registered counter for database nova_cell1 Sep 11 05:21:17.820854 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_db.sqlalchemy.engines [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.825434 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_db.sqlalchemy.engines [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.825661 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.828786 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.831710 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.831841 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writer thread running {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.834652 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writer thread running {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.973023 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.978232 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO dbcounter [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Registered counter for database nova_cell0 Sep 11 05:21:17.981901 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Registered counter for database nova_cell0 Sep 11 05:21:17.987151 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_db.sqlalchemy.engines [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.990926 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:21:17.992090 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writer thread running {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:17.996211 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:21:18.335010 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:21:18.338055 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: WARNING keystonemiddleware.auth_token [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:21:18.342408 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:21:18.345284 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: WARNING keystonemiddleware.auth_token [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:21:18.689186 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:21:18.692203 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: WARNING keystonemiddleware.auth_token [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:21:18.695088 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:21:18.698437 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: WARNING keystonemiddleware.auth_token [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:21:18.700656 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d2d2019c0 pid: 105459 (default app) Sep 11 05:21:18.702737 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:21:18.703760 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d2d2019c0 pid: 105458 (default app) Sep 11 05:21:18.703916 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-07fec06f-8c59-4e2e-a5ef-6e5f0da5e5b1 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Sep 11 05:21:18.704362 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sun Sep 11 05:21:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:40.642360 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:40.643666 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Sep 11 05:22:40.644108 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:40.656708 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:40.657818 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell0:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:40.659254 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell1:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:40.660260 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:41.553160 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0f9f84b2-8379-4bf4-8f8f-5368589ee7ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:41.585984 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0f9f84b2-8379-4bf4-8f8f-5368589ee7ed admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935581 Sep 11 05:22:41.586749 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 11 05:22:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:22:44.214316 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:44.215338 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-6e8f3b8b-7e10-461f-8cf9-0eeeb01fd840 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 11 05:22:44.220773 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:44.697053 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-190190b3-5f6e-4635-9a0d-01cb8b07618a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:44.747217 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-190190b3-5f6e-4635-9a0d-01cb8b07618a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525347 Sep 11 05:22:44.747790 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:22:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:22:44.762269 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_api:SELECT=3 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.763093 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_cell1:SELECT=3 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.765892 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_cell0:SELECT=3 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.766627 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:22:44.985936 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-7e12800d-0ea4-4f61-9ac6-90e033be2868 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:45.063903 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-7e12800d-0ea4-4f61-9ac6-90e033be2868 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307258 Sep 11 05:22:45.064693 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 11 05:22:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:22:47.781052 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-190190b3-5f6e-4635-9a0d-01cb8b07618a admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:47.782060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-190190b3-5f6e-4635-9a0d-01cb8b07618a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 11 05:22:47.782635 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:48.451706 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-7ee48297-8a67-469c-83e1-dd4f0c8b5cc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:48.490232 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-7ee48297-8a67-469c-83e1-dd4f0c8b5cc6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700994 Sep 11 05:22:48.490793 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:22:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:22:48.503536 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-b59d665a-24f6-4810-af29-a334545b9f8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:48.545928 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-b59d665a-24f6-4810-af29-a334545b9f8b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046244 Sep 11 05:22:48.546536 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 11 05:22:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:22:51.187083 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-7ee48297-8a67-469c-83e1-dd4f0c8b5cc6 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:51.188164 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-7ee48297-8a67-469c-83e1-dd4f0c8b5cc6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 11 05:22:51.188572 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:51.620833 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-3dd29143-6dd6-43e6-a040-00020e1e4d36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:51.641225 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-3dd29143-6dd6-43e6-a040-00020e1e4d36 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445557 Sep 11 05:22:51.641225 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:22:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:22:51.654274 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-4437961f-899f-4457-b1a2-302470e8fa2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:51.684407 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-4437961f-899f-4457-b1a2-302470e8fa2e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033486 Sep 11 05:22:51.684881 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 11 05:22:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:22:54.526308 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-3dd29143-6dd6-43e6-a040-00020e1e4d36 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:54.527324 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-3dd29143-6dd6-43e6-a040-00020e1e4d36 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 11 05:22:54.527723 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:22:54.968345 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-cb28355b-8d1d-4511-ab4c-120d9a04cc21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 2}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:54.989721 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-cb28355b-8d1d-4511-ab4c-120d9a04cc21 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455559 Sep 11 05:22:54.990466 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:22:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:22:55.002593 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-d56f14c5-b52c-4152-8dc1-1375a58bb69a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:55.030781 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-d56f14c5-b52c-4152-8dc1-1375a58bb69a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031779 Sep 11 05:22:55.031361 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 11 05:22:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:22:57.730182 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-cb28355b-8d1d-4511-ab4c-120d9a04cc21 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:22:57.731290 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-cb28355b-8d1d-4511-ab4c-120d9a04cc21 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Sep 11 05:22:57.731743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:22:58.207570 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:58.231961 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493184 Sep 11 05:22:58.232673 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:22:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:22:58.246600 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-35d1d068-e7d1-4cbe-be72-94297606d736 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:22:58.274716 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-35d1d068-e7d1-4cbe-be72-94297606d736 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031977 Sep 11 05:22:58.275435 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Sun Sep 11 05:22:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:23:01.201037 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:01.202380 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Sep 11 05:23:01.202949 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:01.662113 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-b81d9295-194a-4f65-af24-33a7b58570ec admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:01.687438 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-b81d9295-194a-4f65-af24-33a7b58570ec admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478451 Sep 11 05:23:01.687986 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 11 05:23:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:23:04.451724 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:04.452678 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-87ae0962-cf0d-4d3b-baee-d8e9acba0be7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 11 05:23:04.453070 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:04.862737 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-484a28c1-fa90-47b7-b5f4-0cc51a753d99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:04.883860 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-484a28c1-fa90-47b7-b5f4-0cc51a753d99 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424744 Sep 11 05:23:04.884449 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:23:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:04.896300 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-e213b73a-9b95-4217-9a2e-9dd3fa0eeef5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:04.923593 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-e213b73a-9b95-4217-9a2e-9dd3fa0eeef5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030941 Sep 11 05:23:04.924199 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 11 05:23:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:23:07.560364 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-484a28c1-fa90-47b7-b5f4-0cc51a753d99 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:07.561959 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-484a28c1-fa90-47b7-b5f4-0cc51a753d99 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Sep 11 05:23:07.562537 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:07.987387 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-8cd4578e-b2f4-4820-91d1-2d4cd52d8101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:08.010467 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-8cd4578e-b2f4-4820-91d1-2d4cd52d8101 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.440242 Sep 11 05:23:08.011381 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:23:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:08.023593 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-a2f80f01-6b67-49f5-8e4e-36b36fad0425 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:08.049517 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-a2f80f01-6b67-49f5-8e4e-36b36fad0425 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030218 Sep 11 05:23:08.050100 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 11 05:23:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:23:10.710052 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-8cd4578e-b2f4-4820-91d1-2d4cd52d8101 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:10.711344 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-8cd4578e-b2f4-4820-91d1-2d4cd52d8101 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Sep 11 05:23:10.711759 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:11.157770 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-8331d635-04f1-4a02-8d7d-0bc97e1af0db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:11.182233 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-8331d635-04f1-4a02-8d7d-0bc97e1af0db admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464473 Sep 11 05:23:11.189805 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:23:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:23:11.194658 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-10b4f979-2b6d-47e1-94a8-db5b17e76a62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:11.199329 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:11.219973 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-10b4f979-2b6d-47e1-94a8-db5b17e76a62 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028926 Sep 11 05:23:11.220822 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 11 05:23:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:23:13.882196 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-8331d635-04f1-4a02-8d7d-0bc97e1af0db admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:13.883205 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-8331d635-04f1-4a02-8d7d-0bc97e1af0db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Sep 11 05:23:13.883773 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:14.341039 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-309a2d17-684b-4c9c-beed-a3a879f0a698 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:14.366459 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-309a2d17-684b-4c9c-beed-a3a879f0a698 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476197 Sep 11 05:23:14.367431 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:23:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:14.423786 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-53336002-22fd-47e7-8abd-ecd234df30ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:14.482143 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-53336002-22fd-47e7-8abd-ecd234df30ad admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105953 Sep 11 05:23:14.492028 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 11 05:23:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:23:17.124018 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-309a2d17-684b-4c9c-beed-a3a879f0a698 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:17.125047 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-309a2d17-684b-4c9c-beed-a3a879f0a698 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 11 05:23:17.125446 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:17.557315 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "disk": 160}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:17.566108 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:17.582952 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450769 Sep 11 05:23:17.583775 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Sun Sep 11 05:23:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:17.596075 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-bf67032d-b851-4f19-8eda-969ceb680e0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:17.632345 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-bf67032d-b851-4f19-8eda-969ceb680e0f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039184 Sep 11 05:23:17.633572 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Sun Sep 11 05:23:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:23:33.646900 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:33.647913 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Sep 11 05:23:33.648447 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:33.658758 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:23:34.039176 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-2aef6d42-6b61-47ac-a9ab-a86660d8510e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:34.057459 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-2aef6d42-6b61-47ac-a9ab-a86660d8510e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403100 Sep 11 05:23:34.058001 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 11 05:23:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:23:35.362981 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:35.363967 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-d0c5788c-b3f2-4f4f-a488-c7e3a80d2296 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 11 05:23:35.364392 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:35.886170 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-86f68912-8bfa-46bf-8282-b76177bca637 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:35.891406 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-86f68912-8bfa-46bf-8282-b76177bca637 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-86f68912-8bfa-46bf-8282-b76177bca637 admin admin] Request method failure captured: Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Host: 10.222.0.33 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjHXDXfjFR-lc-m7DSUXHm2pixBAGZ8hFfcPBVJsEZZLJ5a674_BtEzkHzC9WXAkL8MJtqYvdt9kBYpwCK827KSAavyLPRNZEq4QD1vw8Z16wH9O2E9cS56RoqOelCU1f1LFnoWGYoSfbo63lmRyup9I6d4VBy8OdZQbssra7gLfr_d1w Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 11 05:23:35.894651 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User: admin Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: method: > Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: exception: Flavor 42 could not be found. Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: action_args: {'id': '42'} Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:35.897060 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:35.897992 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.899192 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-86f68912-8bfa-46bf-8282-b76177bca637 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:35.900280 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-86f68912-8bfa-46bf-8282-b76177bca637 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390630 Sep 11 05:23:35.900280 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 11 05:23:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:35.906501 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-6de666ac-0430-4ea5-ab85-21d7aa5caa10 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:35.931477 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-6de666ac-0430-4ea5-ab85-21d7aa5caa10 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028447 Sep 11 05:23:35.932059 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:23:35.942764 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-8234b4e2-42ca-4cf7-94eb-3b75d9197f6b admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:35.964873 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-8234b4e2-42ca-4cf7-94eb-3b75d9197f6b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026682 Sep 11 05:23:35.965410 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:23:35.975599 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-9553efcb-8174-410e-9b7c-c5e47d38316e admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:35.981056 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.wsgi [None req-9553efcb-8174-410e-9b7c-c5e47d38316e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-9553efcb-8174-410e-9b7c-c5e47d38316e admin admin] Request method failure captured: Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept: application/json Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept-Encoding: gzip, deflate Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Connection: keep-alive Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Content-Length: 0 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Host: 10.222.0.33 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-System-Scope: None Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: User-Agent: python-novaclient Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Auth-Token: gAAAAABjHXDXfjFR-lc-m7DSUXHm2pixBAGZ8hFfcPBVJsEZZLJ5a674_BtEzkHzC9WXAkL8MJtqYvdt9kBYpwCK827KSAavyLPRNZEq4QD1vw8Z16wH9O2E9cS56RoqOelCU1f1LFnoWGYoSfbo63lmRyup9I6d4VBy8OdZQbssra7gLfr_d1w Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Id: None Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Name: None Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Identity-Status: Confirmed Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Is-Admin-Project: True Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Id: default Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Name: Default Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Name: admin Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Role: reader,admin,member Sep 11 05:23:35.984491 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Roles: reader,admin,member Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant: admin Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Name: admin Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User: admin Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Id: default Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Name: Default Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Name: admin Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: method: > Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: exception: Flavor 42 could not be found. Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: action_args: {'id': '42'} Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:35.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:35.986943 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:35.988077 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-9553efcb-8174-410e-9b7c-c5e47d38316e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:35.989109 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-9553efcb-8174-410e-9b7c-c5e47d38316e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014672 Sep 11 05:23:35.989109 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 11 05:23:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:37.206693 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-8234b4e2-42ca-4cf7-94eb-3b75d9197f6b admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:37.207698 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-8234b4e2-42ca-4cf7-94eb-3b75d9197f6b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 11 05:23:37.208119 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:37.733874 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-4fa89d29-1654-46ba-889f-0a65686993b3 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:37.738897 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.wsgi [None req-4fa89d29-1654-46ba-889f-0a65686993b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-4fa89d29-1654-46ba-889f-0a65686993b3 admin admin] Request method failure captured: Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept: application/json Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept-Encoding: gzip, deflate Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Connection: keep-alive Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Content-Length: 0 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Host: 10.222.0.33 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-System-Scope: None Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: User-Agent: python-novaclient Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Auth-Token: gAAAAABjHXDZSPr74J3B_TLXj_HCmGjjS1nLoMKXv8piNnHq3Rk-InE5_k1wHQAZ-eIIn9iJus0mUL_nslEP1OQ3xemSlbRTsUsC8062GIqsA4pVZ0IlXq4X7THvKwH5MoCfrDXUdjUyZ2gciBLCVNQNcIa9X2GBEmcSp2SrR0GfeUAPa5c36PU Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Id: None Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Name: None Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Identity-Status: Confirmed Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Is-Admin-Project: True Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Id: default Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Name: Default Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Name: admin Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Role: reader,admin,member Sep 11 05:23:37.740983 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Roles: reader,admin,member Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant: admin Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Name: admin Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User: admin Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Id: default Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Name: Default Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Name: admin Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: method: > Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: exception: Flavor 84 could not be found. Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: action_args: {'id': '84'} Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:37.742494 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:37.743528 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.745124 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-4fa89d29-1654-46ba-889f-0a65686993b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:37.746439 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-4fa89d29-1654-46ba-889f-0a65686993b3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396867 Sep 11 05:23:37.746439 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 11 05:23:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:37.752067 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95b691b5-31f0-47b2-af75-93766f89db7e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:37.767030 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95b691b5-31f0-47b2-af75-93766f89db7e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018469 Sep 11 05:23:37.767556 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:23:37.777056 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-e4083907-ba2c-41ca-a2c2-d6133477db7c admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:37.792848 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-e4083907-ba2c-41ca-a2c2-d6133477db7c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019263 Sep 11 05:23:37.793575 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:23:37.803380 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-6f1a4dae-c408-47d4-a51e-131e5f99ef1f admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:37.808391 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-6f1a4dae-c408-47d4-a51e-131e5f99ef1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-6f1a4dae-c408-47d4-a51e-131e5f99ef1f admin admin] Request method failure captured: Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Host: 10.222.0.33 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjHXDZSPr74J3B_TLXj_HCmGjjS1nLoMKXv8piNnHq3Rk-InE5_k1wHQAZ-eIIn9iJus0mUL_nslEP1OQ3xemSlbRTsUsC8062GIqsA4pVZ0IlXq4X7THvKwH5MoCfrDXUdjUyZ2gciBLCVNQNcIa9X2GBEmcSp2SrR0GfeUAPa5c36PU Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 11 05:23:37.809887 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User: admin Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: method: > Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: exception: Flavor 84 could not be found. Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: action_args: {'id': '84'} Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:37.811513 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:37.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:37.813889 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-6f1a4dae-c408-47d4-a51e-131e5f99ef1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:37.815137 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-6f1a4dae-c408-47d4-a51e-131e5f99ef1f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012059 Sep 11 05:23:37.815137 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Sep 11 05:23:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:39.035679 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-e4083907-ba2c-41ca-a2c2-d6133477db7c admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:39.036751 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-e4083907-ba2c-41ca-a2c2-d6133477db7c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 11 05:23:39.037144 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:39.554994 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-88e1ebed-d879-4985-9c27-f5ba9b05d82e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:39.560722 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-88e1ebed-d879-4985-9c27-f5ba9b05d82e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-88e1ebed-d879-4985-9c27-f5ba9b05d82e admin admin] Request method failure captured: Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Host: 10.222.0.33 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjHXDaxkElZwNYt5Ns18LTZ9HR5toX-30C0ZzmLXd3gRMJABddzL2_6QM-Oq971qGDzI8ouUq2Q8z43rpmwdGjDskMVi0txTzWjMdBo6LIeml76Tv4dPFDGOnAe8vX4C8uhSJwuRdFe6-BCQJA3BqNLBBh2hDMlmY8yDDnDMI-7dam1R4 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 11 05:23:39.562201 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User: admin Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: method: > Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: exception: Flavor 451 could not be found. Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: action_args: {'id': '451'} Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:39.563734 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:39.564731 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.566089 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-88e1ebed-d879-4985-9c27-f5ba9b05d82e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:39.567310 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-88e1ebed-d879-4985-9c27-f5ba9b05d82e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387443 Sep 11 05:23:39.567310 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:23:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:39.573879 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-9261b8bf-d875-4791-9f79-9d9a67fd1a9d admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:39.589252 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-9261b8bf-d875-4791-9f79-9d9a67fd1a9d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018878 Sep 11 05:23:39.589780 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:23:39.599033 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:39.613737 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018225 Sep 11 05:23:39.614253 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Sep 11 05:23:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:23:39.623814 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-ebc3d9e3-fc9f-4fce-93c3-2d287d44d26f admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:39.628685 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.wsgi [None req-ebc3d9e3-fc9f-4fce-93c3-2d287d44d26f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-ebc3d9e3-fc9f-4fce-93c3-2d287d44d26f admin admin] Request method failure captured: Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept: application/json Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Accept-Encoding: gzip, deflate Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Connection: keep-alive Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Content-Length: 0 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Host: 10.222.0.33 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-Api-Version: compute 2.92 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Openstack-System-Scope: None Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: User-Agent: python-novaclient Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Auth-Token: gAAAAABjHXDaxkElZwNYt5Ns18LTZ9HR5toX-30C0ZzmLXd3gRMJABddzL2_6QM-Oq971qGDzI8ouUq2Q8z43rpmwdGjDskMVi0txTzWjMdBo6LIeml76Tv4dPFDGOnAe8vX4C8uhSJwuRdFe6-BCQJA3BqNLBBh2hDMlmY8yDDnDMI-7dam1R4 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Id: None Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Domain-Name: None Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Identity-Status: Confirmed Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Is-Admin-Project: True Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Id: default Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Domain-Name: Default Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Project-Name: admin Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Role: reader,admin,member Sep 11 05:23:39.630181 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Roles: reader,admin,member Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c05020216314cd9bc11af667152fcc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c05020216314cd9bc11af667152fcc9"}]}] Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant: admin Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Id: 4c05020216314cd9bc11af667152fcc9 Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-Tenant-Name: admin Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User: admin Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Id: default Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Domain-Name: Default Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Id: f615cddbb3154c329188ec780374eff5 Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: X-User-Name: admin Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: method: > Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: exception: Flavor 451 could not be found. Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: action_args: {'id': '451'} Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:23:39.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:39.634101 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: ERROR nova.api.openstack.wsgi Sep 11 05:23:39.635416 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-ebc3d9e3-fc9f-4fce-93c3-2d287d44d26f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:23:39.636743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-ebc3d9e3-fc9f-4fce-93c3-2d287d44d26f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012036 Sep 11 05:23:39.636743 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:23:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 05:23:40.853301 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:40.854304 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 11 05:23:40.854699 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:41.378447 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-2e0c2c92-0f97-4d4b-87b1-d39a24d913dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:41.399605 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-2e0c2c92-0f97-4d4b-87b1-d39a24d913dd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405855 Sep 11 05:23:41.400168 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 11 05:23:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:42.625687 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:42.626687 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 11 05:23:42.627084 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:43.150562 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-7e790438-c949-4147-841d-3d73ba59285d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:43.169514 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-7e790438-c949-4147-841d-3d73ba59285d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400664 Sep 11 05:23:43.170054 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 11 05:23:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:44.388894 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:44.389910 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 11 05:23:44.390305 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:44.947958 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-5f14fb71-d9ac-42fb-8413-76801bfafdfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:44.969628 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-5f14fb71-d9ac-42fb-8413-76801bfafdfb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.431328 Sep 11 05:23:44.970167 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 11 05:23:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:46.357610 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:46.358606 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Sep 11 05:23:46.358997 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:46.881485 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-05818e95-8ddc-418b-ab4a-b7f2465be9f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:23:46.899625 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-05818e95-8ddc-418b-ab4a-b7f2465be9f8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401874 Sep 11 05:23:46.900208 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Sep 11 05:23:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:23:48.110101 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:48.111108 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 11 05:23:48.111502 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:23:48.636699 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-b0fd0561-5432-4518-800c-3dbe9a5cd08b admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:23:48.657184 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-b0fd0561-5432-4518-800c-3dbe9a5cd08b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410053 Sep 11 05:23:48.657646 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sun Sep 11 05:23:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:24:45.680356 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:45.681362 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5ae8737f-ee4e-48a8-a539-d3f05f40b34e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 11 05:24:45.681765 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Sun Sep 11 05:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:24:45.692443 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:46.078670 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-db6b33be-3c93-4aff-97f6-30dbc85334a0 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:46.099440 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-db6b33be-3c93-4aff-97f6-30dbc85334a0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411747 Sep 11 05:24:46.099971 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Sun Sep 11 05:24:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:24:46.121130 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=14 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:24:46.124905 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-edb15d30-a661-4c71-8df8-711c881b9432 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:46.132387 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-edb15d30-a661-4c71-8df8-711c881b9432 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012664 Sep 11 05:24:46.132902 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Sun Sep 11 05:24:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:24:46.144762 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-8a81559e-4682-4a54-bacc-c9d368194af7 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:46.152153 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-8a81559e-4682-4a54-bacc-c9d368194af7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010966 Sep 11 05:24:46.152680 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Sun Sep 11 05:24:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:24:46.164749 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:46.171752 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010603 Sep 11 05:24:46.172299 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Sun Sep 11 05:24:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:24:46.184244 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-ce48421c-f5e6-4b18-bc13-c9dc9a38c3dc admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:24:46.192194 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-ce48421c-f5e6-4b18-bc13-c9dc9a38c3dc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011363 Sep 11 05:24:46.192715 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Sun Sep 11 05:24:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:27:40.723070 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:40.724109 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 11 05:27:40.724501 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:27:40.865414 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_api:SELECT=6 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:41.027668 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:41.032448 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:41.033072 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:41.033503 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:41.034220 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:41.034673 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:41.035091 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:41.068258 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-c4af1e7d-a1bb-4d52-b80b-4a0e3d547808 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204059 Sep 11 05:27:41.068838 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:27:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:27:42.146057 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:42.147044 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Sep 11 05:27:42.147430 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:27:42.337852 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:42.341255 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:42.341734 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:42.342160 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:42.342989 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:42.343504 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:42.343919 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:42.364567 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-67a2e535-e126-4c35-9932-9852b5f32ca6 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077140 Sep 11 05:27:42.365051 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:27:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:27:53.864102 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:53.865115 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 11 05:27:53.865511 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:27:54.012656 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_cell0:SELECT=4 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:54.013371 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_cell1:SELECT=4 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:54.013962 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG dbcounter [-] [105458] Writing DB stats nova_api:SELECT=8 {{(pid=105458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:27:54.061853 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:54.065269 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:54.065744 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:54.066168 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:54.066873 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:54.067316 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:54.067727 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:54.092744 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-53bca260-e32d-4af1-9e7b-f556082560f1 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084508 Sep 11 05:27:54.093287 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:27:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:27:55.168608 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:55.169604 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5735df5c-dbd2-4ec2-9dd6-54e719a427ed admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 11 05:27:55.169996 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Sep 11 05:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:27:55.358882 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG nova.api.openstack.wsgi [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Calling method '>' {{(pid=105458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:27:55.362338 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:55.362817 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:55.363245 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:55.363959 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:27:55.364432 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:27:55.364856 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: DEBUG oslo_concurrency.lockutils [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:27:55.386588 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: INFO nova.api.openstack.requestlog [None req-466bd260-8d77-4a8c-bc3e-8c604a0f1e48 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079324 Sep 11 05:27:55.387078 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: [pid: 105458|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Sep 11 05:27:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:28:54.140933 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: Sun Sep 11 05:28:54 2022 - graceful shutdown triggered... Sep 11 05:28:54.141441 dv-cinder-856921-1-iscsi devstack@n-api.service[105458]: Gracefully killing worker 1 (pid: 105458)... Sep 11 05:28:54.143685 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: Gracefully killing worker 2 (pid: 105459)... Sep 11 05:28:54.144440 dv-cinder-856921-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 05:28:54.270005 dv-cinder-856921-1-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=4 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:28:55.142595 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: worker 1 buried after 1 seconds Sep 11 05:28:55.143141 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: worker 2 buried after 1 seconds Sep 11 05:28:55.143141 dv-cinder-856921-1-iscsi devstack@n-api.service[105457]: goodbye to uWSGI. Sep 11 05:28:55.144342 dv-cinder-856921-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 11 05:28:55.144877 dv-cinder-856921-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 05:28:55.147659 dv-cinder-856921-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 05:28:55.156924 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 05:28:55 2022] *** Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: nodename: dv-cinder-856921-1-iscsi Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: machine: x86_64 Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: clock source: unix Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: pcre jit disabled Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: detected number of CPU cores: 4 Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: current working directory: / Sep 11 05:28:55.159230 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: detected binary path: /usr/bin/uwsgi-core Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: your processes number limit is 47680 Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: your memory page size is 4096 bytes Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: detected max file descriptor number: 2048 Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: lock engine: pthread robust mutexes Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: thunder lock: enabled Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 05:28:55.159897 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 05:28:55.199880 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: Python main interpreter initialized at 0x559cf6b3a9c0 Sep 11 05:28:55.200158 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: python threads support enabled Sep 11 05:28:55.200295 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: your server socket listen backlog is limited to 100 connections Sep 11 05:28:55.200425 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: your mercy for graceful operations on workers is 90 seconds Sep 11 05:28:55.200849 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 05:28:55.201074 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: *** Operational MODE: preforking *** Sep 11 05:28:55.201496 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: *** uWSGI is running in multiple interpreter mode *** Sep 11 05:28:55.201627 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: spawned uWSGI master process (pid: 120625) Sep 11 05:28:55.201933 dv-cinder-856921-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 05:28:55.205220 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 1 (pid: 120643, cores: 1) Sep 11 05:28:55.205220 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 2 (pid: 120644, cores: 1) Sep 11 05:28:55.205220 dv-cinder-856921-1-iscsi devstack@n-api.service[120625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 05:28:55.873730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 05:28:55.880766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 05:28:57.051817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:28:57.051817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: from cryptography.utils import int_from_bytes Sep 11 05:28:57.052599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:28:57.052599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: from cryptography.utils import int_from_bytes Sep 11 05:28:57.060646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:28:57.060646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 11 05:28:57.061259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 05:28:57.061259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 11 05:28:59.488167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:28:59.489035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:28:59.489575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:28:59.489955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:28:59.490219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:28:59.490621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.490958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.491288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.491613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.491952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.492298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.492627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.492956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.493290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.493555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.493882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.494087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 05:28:59.494474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856921-1-iscsi {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.494579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 05:28:59.494672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.494894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 05:28:59.495001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.495269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 05:28:59.495371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.495568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 05:28:59.495670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.495908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.496919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.497107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.497290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.498815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.499026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.499131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.499412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.499532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.499724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.500038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.500269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.500500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.500714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856921-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.500925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.501215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.501215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856921-1-iscsi {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.502968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.503758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.504959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.505910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.506924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.507030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856921-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.507216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.507642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.507774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.507880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.508934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.509986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.510976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.511879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.512863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.513914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.514992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.515146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.515291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.515443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.515587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.516981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.517895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.518978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.519863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.520967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.521864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.522937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.523751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.523909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.524886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.525820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.526188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.526350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.526505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.526660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.526906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.527968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.528899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.529948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.530987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.531864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.532026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.532186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.532859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.533908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.534946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.535858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.536055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.536445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.536601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.536746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.536915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.537155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.537317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.537472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.537624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.537624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.537924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.538093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.538247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.538393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.538544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.538690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.538833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.538988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.539141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.539292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.539444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.539588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.539738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.539969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.540153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.540307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.540453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.540604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.540758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.540911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.541055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.541205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.541357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.541511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.541671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.541823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.541979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.542129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.542281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.542427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 05:28:59.542584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.542736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.542881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.543924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.544891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.545948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.546092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.546476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.546636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.546791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.546937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.547970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.548671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.548829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.548983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.549867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.550912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.551955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.552192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.552348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.553487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.553666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.553825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.553983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.554898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.555957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.556141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.557146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.557327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.557588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.557750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.557895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.558976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.559859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.560848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.561942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.562868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.563957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.564948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.565855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.566000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.566154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.566305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.566459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.566884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.567907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.568938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.569995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.570892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.571944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.572888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.573965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.574920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.575925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.576815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.577933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.578913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.579872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.580870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.581807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.582782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.583931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.584882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.585982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.586917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.587913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.588981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.589998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.590173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.590316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.590503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.590637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.590873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.591900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.592972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.593930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.594146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.594280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.594417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.594548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.594677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.595400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.595569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.595722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.595844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.596909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.597031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.597232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.597734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.597856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.597969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.598950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.599815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.600165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.600302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.600770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.601100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.601425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.601756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.601882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.602879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.603809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.604097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.604428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.604757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.604909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.605903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.606106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.606253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.606591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.606699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.606914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.607958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.608971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.609921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.610103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.610253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.610399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.610603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.610959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.611906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.612990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.613918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.614874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.615897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.616960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.617876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.618921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.619851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.620938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.621917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.622951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.623965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.624977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.625888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.626026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.626721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.626867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.627903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.628889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.629993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.630928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.631987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.632236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.632860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.632970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.633822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.634975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.635922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.636987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.637211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.637303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.637537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.637637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.637869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.638923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.639906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.640862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.641936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.642926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.643902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.644863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.645833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.646783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.647981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.648970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.649934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.650985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.651227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.651331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.651539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.651654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.651933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.652954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.653269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.653379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.653591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.653685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.653904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.654966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.655926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.656913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.657047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.657234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.657891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.658829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.659887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.660996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.661169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.661318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.661490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.661658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.661821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.662977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.663980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.664969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.665909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.666881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.667870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.668868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.669972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.670925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.671877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.672955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.673201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.673295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.673526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.673812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.673906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.674883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.675802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.676964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.677928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.678977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.679976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.680962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.681943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.682846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.683804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.684905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.685875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.686831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.687770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.688814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.689853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.690814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.691929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.692939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.693995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.694944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.695931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.696922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.697986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.698984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.699965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.700922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.701858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.702925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.703962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.704835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.704946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.705908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.706940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.707875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.708975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.709940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.710178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.710270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.710499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.710591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.710811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.711825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.712798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.713837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.714975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.715926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.716987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.717954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.718167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.718266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.718488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.718581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.718803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.719865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.720637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.720818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.720995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.721965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.722972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.723923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.724890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.725834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.726947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.727961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.728947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.729985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.730956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.731933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.732956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.733937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.734917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.735093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.735267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.735437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.735617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.736860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.737826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.738795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.739938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.740897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.741855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.742786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.743926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.744949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.745903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.746934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.747919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.748877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.749786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.750940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.751907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.752905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.753948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.754904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.755854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.756854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.757064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.757156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.757384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.757737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.757978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.758960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.759912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.760052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.760254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:28:59.760366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.760660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.760971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.761292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.761614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.761934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.762256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.762582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.762902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.763222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.763549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.763874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.764240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.764582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.764908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.765247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.765590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.765950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.766275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.766629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.767585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.767916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.768286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.768609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 05:28:59.768863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 05:28:59.823348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Registered counter for database nova_api Sep 11 05:28:59.831846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Registered counter for database nova_api Sep 11 05:28:59.844351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.851733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:28:59.852719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.859271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:28:59.909549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.context [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf3f0c85-0dae-4d22-94ea-a598ee9fea69(cell1) {{(pid=120644) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 05:28:59.913603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:28:59.914080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:28:59.915645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:28:59.916416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:28:59.916834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.context [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf3f0c85-0dae-4d22-94ea-a598ee9fea69(cell1) {{(pid=120643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 05:28:59.916936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:28:59.918854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:28:59.920854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:28:59.920979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Registered counter for database nova_cell0 Sep 11 05:28:59.921341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:28:59.922956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:28:59.923818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:28:59.924313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:28:59.925171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Registered counter for database nova_cell1 Sep 11 05:28:59.926345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:28:59.928418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Registered counter for database nova_cell0 Sep 11 05:28:59.932970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Registered counter for database nova_cell1 Sep 11 05:28:59.934391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.937461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.942935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.943705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:28:59.945364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:28:59.950405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:28:59.952482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:29:00.086145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:29:00.096822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Registered counter for database nova_cell0 Sep 11 05:29:00.101624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Registered counter for database nova_cell0 Sep 11 05:29:00.103976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:29:00.108415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 05:29:00.108588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:29:00.113267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 05:29:00.440244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:29:00.447524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:29:00.449500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:29:00.457367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:29:00.803941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:29:00.810917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-f0f89b37-fb05-4306-a01e-8f2d155eb070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:29:00.811644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 05:29:00.818499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-6f956a56-058c-488f-a149-b8231853b3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 05:29:00.818936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cf6b3a9c0 pid: 120643 (default app) Sep 11 05:29:00.823874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cf6b3a9c0 pid: 120644 (default app) Sep 11 05:29:45.280472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:45.287471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:45.288792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:45.290001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:47.199974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-faa8aa98-94ea-40df-9f7d-54fabfcd1452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: .version_select at 0x7f2c401114c0>, body: {"keypair": {"name": "tempest-keypair-1919299396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFRWaT7gOXJt2P23zkNQBYUK2FW78f3+MJl/fiLkmsTjYf0AxPLJ62e/ciBqe8hCPuhoLe8lJ+ujbu715mmwODkxsOkQ2D1ZHHn1y6arLg3IIbF0Yy5uddNoR24aRP4kg=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:29:47.345361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-faa8aa98-94ea-40df-9f7d-54fabfcd1452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:29:47.373955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-faa8aa98-94ea-40df-9f7d-54fabfcd1452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:29:47.526212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-faa8aa98-94ea-40df-9f7d-54fabfcd1452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.266567 Sep 11 05:29:47.532181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:29:50.074410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.077211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.080491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.081629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:29:50.773849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358199329", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:29:51.430231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] validate_networks() for [('292005db-ed4c-41e2-9867-8cd96d81fc55', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:29:52.610500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1059793899", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42ad47aa-0576-4a66-864b-0cf4e79a54c6"}], "security_groups": [{"name": "tempest-securitygroup--645583142"}], "key_name": "tempest-keypair-1919299396", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:29:53.087076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] validate_networks() for [('42ad47aa-0576-4a66-864b-0cf4e79a54c6', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:29:54.314238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:29:54.316462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:29:54.320388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:29:54.322953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:29:54.323647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:29:54.384402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:54.385121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:54.389006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:54.389894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:54.392147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:54.392147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:54.431408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:29:54.444976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:29:54.489894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:29:54.494374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:29:54.701813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9bd7119-f47e-49ad-886b-c020931d5467 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.097666 Sep 11 05:29:54.714142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:29:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:29:54.731465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46f4a607-6908-4a39-8c7a-f9a6c1e3f6e4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:54.732302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46f4a607-6908-4a39-8c7a-f9a6c1e3f6e4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:55.036260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46f4a607-6908-4a39-8c7a-f9a6c1e3f6e4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:55.082445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46f4a607-6908-4a39-8c7a-f9a6c1e3f6e4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1242 microversion: 2.1 time: 0.366432 Sep 11 05:29:55.083054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 3/3] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1242 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:29:55.326101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:29:55.326633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:29:55.328187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:29:55.329053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:29:55.329661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:29:55.395562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:55.398154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:55.401051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:55.406532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:55.408348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:55.411889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:55.527691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:29:55.543226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for user f4c978e96d3248d59120c287ecc75e87 and project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:29:55.579497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:29:55.584690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:29:55.779076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f30c116-ec88-4cb3-b62e-d95647b07ef1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.732393 Sep 11 05:29:55.797926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1/4] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 5753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:29:55.799126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5a2c3f1-7445-4e33-8aca-ce9b2da5feb5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:55.799754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5a2c3f1-7445-4e33-8aca-ce9b2da5feb5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:56.020160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5a2c3f1-7445-4e33-8aca-ce9b2da5feb5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:56.031360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5a2c3f1-7445-4e33-8aca-ce9b2da5feb5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1221 microversion: 2.1 time: 0.235451 Sep 11 05:29:56.032518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 4/5] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:55 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:29:56.109555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c97a4a70-2f57-489c-99f7-2f6105863a3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:56.110362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c97a4a70-2f57-489c-99f7-2f6105863a3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:56.369975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1108787262", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:29:56.509362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c97a4a70-2f57-489c-99f7-2f6105863a3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:56.514859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] validate_networks() for [('292005db-ed4c-41e2-9867-8cd96d81fc55', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:29:56.559345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c97a4a70-2f57-489c-99f7-2f6105863a3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1242 microversion: 2.1 time: 0.454837 Sep 11 05:29:56.584274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 2/6] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1242 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:29:57.611047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:57.612658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:57.625467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:57.627187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:57.628533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:57.631140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:57.632664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:57.635129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:58.138360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:58.168712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a6dc90d-9e44-4084-8666-c46208f4d68b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1294 microversion: 2.1 time: 0.572012 Sep 11 05:29:58.171588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1294 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:29:58.182582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:29:58.183723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:29:58.184389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:29:58.185017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:29:58.185540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:29:58.204850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:58.205585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:58.206145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:58.207165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:58.207743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:58.208318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:58.237837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:29:58.245995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for user f4c978e96d3248d59120c287ecc75e87 and project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:29:58.302078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:29:58.309962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:29:58.424406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96b3bca2-ff0a-4259-88f3-cfbf98d2794e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.059226 Sep 11 05:29:58.425772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 5/8] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:29:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:29:58.441193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-913cbd25-a657-4881-9056-3f789e9273b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:58.442346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-913cbd25-a657-4881-9056-3f789e9273b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:58.919301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-913cbd25-a657-4881-9056-3f789e9273b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:58.927781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-913cbd25-a657-4881-9056-3f789e9273b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1222 microversion: 2.1 time: 0.494919 Sep 11 05:29:58.932194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 4/9] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:58 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1222 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:29:59.203847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:59.205731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:59.240507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:59.245151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:59.247239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:59.257301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:59.258790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:59.259457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:59.799755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-931638284", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "networks": [{"uuid": "b8bd90df-f994-49b0-87be-74d3c2cdc5e4"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:29:59.831806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:29:59.858251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92a008b6-1d54-473d-a51e-1f294b39af1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1294 microversion: 2.1 time: 0.666844 Sep 11 05:29:59.859773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 6/10] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1294 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:29:59.891104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] validate_networks() for [('b8bd90df-f994-49b0-87be-74d3c2cdc5e4', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:29:59.960364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:29:59.961039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:29:59.975100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:59.975921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:59.976586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:29:59.977479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:29:59.978080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:29:59.978668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:00.385383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:00.401706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d7d2f0b-e31e-427a-bebc-c4bdf8992996 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1226 microversion: 2.1 time: 0.445305 Sep 11 05:30:00.420197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:29:59 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1226 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:00.554133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f254ebe-6606-462a-8b1c-8498ab7273e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: .version_select at 0x7f2c3f5c23a0>, body: {"keypair": {"name": "tempest-keypair-993328104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNDkqR7Kjpizvnz6mqEVwKs7vVWXuLoLWwRTkzUUq6HxjnxERus06Mu5GElh2ealrb+tdtzkiE52nwqc+CsC/RRm+vKMAjieV0bRCup0cCRzaN9obpXifM1Nj8hBg4FGQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:00.603630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:30:00.610363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:30:00.611074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:30:00.611492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:30:00.614536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:30:00.616515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-0f254ebe-6606-462a-8b1c-8498ab7273e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:30:00.628616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-0f254ebe-6606-462a-8b1c-8498ab7273e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for user 32df696da09746748786b94aa8b6721d and project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:30:00.633682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:00.635449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:00.637555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:00.639024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:00.639756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:00.641103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:00.672368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Getting quotas for project 431b72dd50e44a53a597b28404ace63c. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:30:00.680076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Getting quotas for user 065c988c57fa47e9b58af2914ff6306d and project 431b72dd50e44a53a597b28404ace63c. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:30:00.710613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f254ebe-6606-462a-8b1c-8498ab7273e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.289037 Sep 11 05:30:00.711220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 8/12] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:30:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:00.712419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:30:00.731722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:30:00.873877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c3163e7c-2472-43ee-9f2d-c3f829180d6f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371985 Sep 11 05:30:00.876666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 5/13] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 05:30:00.899103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:00.899966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de46b8c0-dff3-41ce-a80b-ecdc5090b9a6 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:00.900298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:00.916020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:00.917460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:00.919885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de46b8c0-dff3-41ce-a80b-ecdc5090b9a6 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:00.920822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:00.921813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:00.923357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:00.925032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:01.084562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:01.085962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de46b8c0-dff3-41ce-a80b-ecdc5090b9a6 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:01.126152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de46b8c0-dff3-41ce-a80b-ecdc5090b9a6 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1214 microversion: 2.1 time: 0.238763 Sep 11 05:30:01.126742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:00 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:01.128992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f5030c1-d000-43dd-bb33-bd95c3d2213a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1294 microversion: 2.1 time: 0.233000 Sep 11 05:30:01.132224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 6/15] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1294 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:01.435096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:01.435618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:01.447299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:01.447787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:01.453043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:01.453711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:01.454362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:01.454936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:01.639068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:01.657079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b267499b-d84f-42c2-947a-68cc2d50e2c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1226 microversion: 2.1 time: 0.225778 Sep 11 05:30:01.658657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 7/16] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:01 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:02.049750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e160a98-e169-4271-80fe-ed1ce200ce6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: .version_select at 0x7f2c3f5d60d0>, body: {"keypair": {"name": "tempest-keypair-1116270512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU47UpArgIkUg1s1aE6/Uh/uaGNbW5qTKCRbIRTYR7kTHFYbZCTHgfHlD+KdxmckFh+8M+rRFhS3Sy3KUKOWFq7XJvoZ2q9HuIlT+4k7xx0w0fzYFur3a9aD6F0ONjClQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:02.101254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5e160a98-e169-4271-80fe-ed1ce200ce6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for project 37c662b75f1d46619c3993132d413549. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:30:02.115139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5e160a98-e169-4271-80fe-ed1ce200ce6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for user 0d1dbe40cb994491bafc6ce1f947f4f6 and project 37c662b75f1d46619c3993132d413549. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:30:02.156870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:02.157545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:02.165490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.167425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e160a98-e169-4271-80fe-ed1ce200ce6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.700358 Sep 11 05:30:02.176609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.177791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:02.177951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 10/17] 10.222.0.33 () {62 vars in 1200 bytes} [Sun Sep 11 05:30:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 711 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 11 05:30:02.183226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:02.184335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.184962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.185787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:02.191187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:02.208036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.208495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.209060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:02.209723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.213781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.214396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:02.333629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:02.342172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35dadba2-46cb-4d62-9a97-fc410fe2d74e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1218 microversion: 2.1 time: 0.162958 Sep 11 05:30:02.345001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 11/18] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:02 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:02.477528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:02.512726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34bae152-f50a-4181-95a1-0b686068b1db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1312 microversion: 2.1 time: 0.354614 Sep 11 05:30:02.514123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 8/19] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1312 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:02.689765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:02.693369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:02.710784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.711375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.711715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:02.712451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:02.712910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:02.713338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:03.025202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:03.041099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c048c281-f35e-49dd-960d-24a71f5fb642 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1274 microversion: 2.1 time: 0.357663 Sep 11 05:30:03.059301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 12/20] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:02 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:03.376320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:03.376966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:03.402559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:03.403984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:03.406250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:03.409297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:03.413183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:03.413713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:03.541350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:03.542170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:03.555747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:03.556282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:03.566353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:03.569053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:03.569585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:03.579103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:03.793759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:03.805133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b478a4f9-4b83-4460-9924-349513c489aa tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1210 microversion: 2.1 time: 0.437401 Sep 11 05:30:03.815414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 9/21] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:03 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1210 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:03.856309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:03.872560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3836a3cf-a688-4e74-8700-55187d35ec8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1300 microversion: 2.1 time: 0.337987 Sep 11 05:30:03.873160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 13/22] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1300 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:04.091241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:04.092170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:04.113376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.113798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.121199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:04.122830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.124160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.125098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:04.520429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:04.530922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ddc40f3-45ae-4914-96d1-3d6db04eb0a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1280 microversion: 2.1 time: 0.449986 Sep 11 05:30:04.553125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 10/23] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:04 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1280 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:04.706706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1231421294", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8d1f3f0-5341-458c-96ea-8e56a8e64464"}], "security_groups": [{"name": "tempest-securitygroup--1495619289"}], "key_name": "tempest-keypair-993328104", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:04.831608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:04.832521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:04.850947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.853107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.856405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:04.862811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.863204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.863649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:04.948401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:04.958187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3579ab25-77e0-4753-96f9-ec773a1dc9fb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1210 microversion: 2.1 time: 0.131291 Sep 11 05:30:04.959290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:04 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:04.976538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:04.977557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:04.987892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.988680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.989118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:04.989978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:04.990606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:04.991387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:05.033983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] validate_networks() for [('e8d1f3f0-5341-458c-96ea-8e56a8e64464', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:30:05.088622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:05.100936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5849b49e-273e-4e4e-b51f-7801e26b64ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1300 microversion: 2.1 time: 0.139558 Sep 11 05:30:05.101605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:05.566037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:05.566726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:05.587514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:05.588852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:05.589443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:05.590474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:05.591106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:05.591686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:05.720215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:05.743312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e8ec641-3558-4951-9402-9ebea6ae4360 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1280 microversion: 2.1 time: 0.186630 Sep 11 05:30:05.746784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:05 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:05.984663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:05.985294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:05.995863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:05.998877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.002011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.002961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.004570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.005789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.126345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:06.142230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15761861-55cb-4cba-ae3d-56ea215eae49 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1210 microversion: 2.1 time: 0.161787 Sep 11 05:30:06.148220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:05 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:06.158157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:06.168078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:06.182023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.182818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.184248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.189186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.189882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.190400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.558292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:06.564082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:30:06.564555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:30:06.571394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:30:06.571394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:30:06.571394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:30:06.595315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0804edb-02ad-441f-bcd7-1dcd4aced50e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.445645 Sep 11 05:30:06.613943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 15/28] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:06.618974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.623946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.624847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.625992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.628878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.635303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.697677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:06.731104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:30:06.748377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for user 32df696da09746748786b94aa8b6721d and project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:30:06.776509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:06.777121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:06.789614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:30:06.790396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.791102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.791754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.793038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:06.804435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:06.808667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:06.815332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:30:06.925606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63484602-d205-430d-a97d-263de3cba3c7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.228290 Sep 11 05:30:06.928169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 14/29] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:30:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:30:06.948923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d60d280-4d25-4aab-9d41-e203aa8a6993 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:06.951250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d60d280-4d25-4aab-9d41-e203aa8a6993 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:06.975392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:06.984994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f82e2fd6-f2c2-40cc-ac83-bceeb528ba1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1280 microversion: 2.1 time: 0.217496 Sep 11 05:30:06.991651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 16/30] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:06 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:07.090075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d60d280-4d25-4aab-9d41-e203aa8a6993 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:07.106118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d60d280-4d25-4aab-9d41-e203aa8a6993 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1237 microversion: 2.1 time: 0.170600 Sep 11 05:30:07.106702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 15/31] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:07.175172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:07.175791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:07.194644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:07.196787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:07.197433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:07.198346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:07.201189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:07.201797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:07.340748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:07.349640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-174232fc-e27c-4038-8086-5b5c9df4b5c4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1210 microversion: 2.1 time: 0.178961 Sep 11 05:30:07.354676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:07 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:07.600382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-937340353", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58a2a799-a636-430c-8f78-e9d1e031567c"}], "security_groups": [{"name": "tempest-securitygroup--1377080111"}], "key_name": "tempest-keypair-1116270512", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:07.620418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:07.621560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:07.629544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:07.630324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:07.630954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:07.632511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:07.633699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:07.634367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:07.900137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] validate_networks() for [('58a2a799-a636-430c-8f78-e9d1e031567c', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:30:08.062050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:08.072155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ac9db91-b03b-4b79-872b-eb569b8c1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.455298 Sep 11 05:30:08.072968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 18/33] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:08.088708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:08.091383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:08.117586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.121618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.122364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:08.123591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.125924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.128878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:08.327328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:08.344573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fbe53c5-5c66-44cc-ba9b-d14dee3cb5eb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1280 microversion: 2.1 time: 0.269738 Sep 11 05:30:08.345775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 19/34] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:08 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:08.350818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:08.351725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:08.359191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.360119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.360742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:08.361879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.362844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.363507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:08.554172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:08.567397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:08.576846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1be7153a-8210-4f8b-8936-19a3804773f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1241 microversion: 2.1 time: 0.229658 Sep 11 05:30:08.580439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 20/35] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:08.595384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:08.602025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:08.632097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.645862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.648210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:08.672113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:08.672113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:08.672113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:09.201935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:09.217110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e515ba60-08d9-4d7e-8662-34505e37b5e2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1266 microversion: 2.1 time: 0.632620 Sep 11 05:30:09.234848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 21/36] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:08 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1266 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:09.274555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:09.281183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:09.310837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:09.312977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:09.314008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:09.316681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:09.320869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:09.326260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:09.754308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:30:09.754859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:30:09.755231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:30:09.755657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:30:09.756097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:30:09.776823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:09.777433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:09.783966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:09.785057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:09.785554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:09.786001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:09.904431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for project 37c662b75f1d46619c3993132d413549. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:30:09.950578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for user 0d1dbe40cb994491bafc6ce1f947f4f6 and project 37c662b75f1d46619c3993132d413549. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:30:10.058446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:30:10.061002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:30:10.316149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f99a8897-7f09-447f-a6dd-985066ffc96f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.721673 Sep 11 05:30:10.317389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 16/37] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Sep 11 05:30:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 11 05:30:10.353603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:10.356631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:10.381142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:10.385257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:10.385764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:10.386535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:10.387045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:10.389742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:10.652152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:10.674582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:10.688893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e05d340-13d6-4071-baed-b5e8eccc6dbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 1.447628 Sep 11 05:30:10.691771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 22/38] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:10.705152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:10.708708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:10.734025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=16 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:10.739586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:10.744148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:10.746608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:10.766417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:10.767740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:10.769450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.081032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:12.100830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-532a22f4-9abf-497d-a09a-7f5ef734a494 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 1.781796 Sep 11 05:30:12.107270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 17/39] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:10 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:12.176156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:12.184454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:12.253415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.254303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.254881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.265157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.269497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.271207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.533129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:12.553319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b4227e7-d22a-4509-9cd8-a5cb3eb4b1aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1289 microversion: 2.1 time: 1.850052 Sep 11 05:30:12.554249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 23/40] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1289 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:12.597261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:12.600197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:12.619322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.623714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.627030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.633144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.633867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.634967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.892699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:12.904930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:12.907477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:12.909629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-821b466f-f9d8-4d4f-8525-f8b51713c9b3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.327202 Sep 11 05:30:12.932104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 24/41] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:12.938038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:12.938725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:12.948900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.949312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.949783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:12.950495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:12.950952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:12.951383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.263002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:13.274937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52498aae-2323-4850-9225-b03628c1a1c3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1272 microversion: 2.1 time: 1.147727 Sep 11 05:30:13.276026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 18/42] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:12 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1272 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:13.286317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:13.287385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:13.301173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.301777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.302650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.305036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.305835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.306576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.507442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:13.519810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-653049ad-cf5a-43e5-bae1-9f5ef2be7785 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.586458 Sep 11 05:30:13.520441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 25/43] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:13.580297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:13.581574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:13.598302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.601302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.601916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.604372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.605038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.605873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.768081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:13.790182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0247d0e-3aaa-491d-88e5-d8053592abcd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.212634 Sep 11 05:30:13.810952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 26/44] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:13.863709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:13.879354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f83a06d-7681-4a67-96b6-5e16ddb8f40f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.601811 Sep 11 05:30:13.881333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 19/45] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:13 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:13.938358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:13.939163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:13.950197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.951717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.955147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:13.956196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:13.957835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:13.962167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:14.097186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:14.136294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:14.138108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:14.145103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15b11020-138c-435c-a627-1661b7c80289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.208546 Sep 11 05:30:14.160023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 27/46] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:14.301257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:14.302329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:14.313937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:14.316477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:14.316929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:14.317663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:14.318198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:14.318644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:14.550243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:14.550883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:14.563884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:14.563884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:14.564684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:14.565021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:14.565506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:14.565963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.012092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.031307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6beb88d3-a99d-48f2-a541-f7b3dca07561 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.485572 Sep 11 05:30:15.046848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 28/47] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:15.057456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:15.058910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:15.069087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.069780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.070404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.071283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.071889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.072509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.179643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.216576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e26a050-9a1b-49cb-87c3-4272c39e9931 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.156594 Sep 11 05:30:15.219273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 29/48] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:15.237903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.251083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:15.262441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:15.268102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d18c574d-e641-4817-ba01-30cb67d94a2d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.973103 Sep 11 05:30:15.268700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 20/49] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:14 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:15.285989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:15.287395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:15.296093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.297314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.298258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.299097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.299250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.299979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.300218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.300643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.302071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.302803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.303273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.303706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.449417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.453164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=67 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:15.464906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.469055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.470882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cbdc4f8e-9a99-465b-ba87-ebc87a5e4538 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.197659 Sep 11 05:30:15.472722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 21/50] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:15.499476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:15.508946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da14eb9c-c6e1-4888-a618-72b27af9fd4a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.288275 Sep 11 05:30:15.510145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 30/51] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:15 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:15.567857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0651b94-3604-4b72-8562-7b252652c725", "tag": "7b14db7f-83e7-446e-8ada-d567e4c34601"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:15.585270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.586137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.587341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.623846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Creating event network-changed:7b14db7f-83e7-446e-8ada-d567e4c34601 for instance f0651b94-3604-4b72-8562-7b252652c725 on hv-cinder-85692 Sep 11 05:30:15.624430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 05:30:15.624980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e4e51601-0d58-4e3b-9537-977a194fb523 req-d9de7391-bfb8-467f-83b0-9a5aa34d4106 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 05:30:15.627104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.627592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.628058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.628791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:15.629245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:15.629676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:15.636222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=9 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:15.649400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.compute.rpcapi [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 05:30:15.650525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] Releasing lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 05:30:15.671691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1469108f-c2d1-449a-b2e8-ea27e04c4035 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197431 Sep 11 05:30:15.678791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 22/52] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:16.058400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:16.059406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:16.066425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.066823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.067262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.067955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.068429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.069214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.222602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.237683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6de056da-41a4-4c98-9a18-30c43c07825a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.183078 Sep 11 05:30:16.241883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:16.242640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:16.243284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 31/53] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:16.251232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.251891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.252527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.253416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.253879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.254432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.330291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.340870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:16.343644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:16.350138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82b461a1-b7ac-4964-ac01-8027b9e081fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.112378 Sep 11 05:30:16.350753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 23/54] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:16.359639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.360164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.361884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.371654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.377118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.377563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.497367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:16.498320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:16.510107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.512780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.513406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.517104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.519853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.522647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.610983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.627547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a069e5da-add7-4d45-b7c8-8839a1bc2279 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.332422 Sep 11 05:30:16.628176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 32/55] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:16 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:16.658296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:16.658878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:16.668548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.679542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.681637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.682053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.682626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.683568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3ed5c24-e7e9-4b60-8934-1f59fa3e47d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.190209 Sep 11 05:30:16.684442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 24/56] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:16.690886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.691763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:16.692574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:16.694976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:16.936792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:16.951426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8be43b39-1206-4e95-87b9-a82ed5c19302 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.303252 Sep 11 05:30:16.954534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 33/57] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:16 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:17.266870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:17.268296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:17.286567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.288767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.290479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.291482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.294848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.296449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.373597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:17.374244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:17.377627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:17.385175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.385674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.386206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.386925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.387384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.387820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.509030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.520509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-657460c0-cb3d-4ada-9cca-10dccb2b7aaf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.150918 Sep 11 05:30:17.521308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 34/58] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:17.580195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.595778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd4c493d-de10-4946-922c-276fb8206022 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.336437 Sep 11 05:30:17.612612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 25/59] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:17.659895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:17.660431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:17.668878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.669594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.670256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.672613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.673246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.674775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.694239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42e41e9-5297-4be5-a77d-6558fdb3b01f", "tag": "de1a56c3-9f13-4434-afbc-573439a20fe3"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:17.707472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.718951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.719836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.735703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] Creating event network-changed:de1a56c3-9f13-4434-afbc-573439a20fe3 for instance c42e41e9-5297-4be5-a77d-6558fdb3b01f on hv-cinder-85692 Sep 11 05:30:17.755837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-d80cb164-cae9-4cfc-a77d-1577f9ae1aa3 req-8e789230-14a6-4b78-a46f-43836c494360 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065943 Sep 11 05:30:17.757375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 26/60] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:30:17.774742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:17.776698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:17.788181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.788791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.789257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.790058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.790572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.791023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.884197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.909217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.911619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.913601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-452a9e36-3248-4779-956c-866875c608d9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.153941 Sep 11 05:30:17.915694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 27/61] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:17.933721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:17.969124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a14ee200-4fd5-43e3-ba3f-43a01157189b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.313798 Sep 11 05:30:17.970307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 35/62] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:17 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:17.979102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:17.979871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:17.988840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.991406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.991861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:17.992641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:17.994942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:17.995377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.239507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:18.249352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c35a639b-15c4-4f73-8704-4d034092553a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.274098 Sep 11 05:30:18.250038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 28/63] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:17 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:18.544963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:18.546244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:18.553054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.554114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.554710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.556437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.557227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.557797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.629492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:18.631494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:18.646834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.648331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.649385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.651654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.653057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.653516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.668470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:18.679204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b79f19a5-bd5e-419f-bb3f-0222040ba4fa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.138299 Sep 11 05:30:18.679952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 36/64] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:18.924864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:18.934760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf9a195e-520e-4aa6-927a-4c44b27076c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.318119 Sep 11 05:30:18.935343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 29/65] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:18.950692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:18.951354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:18.958547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.959402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.960053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.961032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:18.962188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:18.963012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:18.985903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:18.994727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:18.995333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:19.003142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.003941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.004374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.005055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.005506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.006263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.044305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.059006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.060479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.062332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e4dbece-ffa1-45c8-8f76-d10e5574c25e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.122289 Sep 11 05:30:19.063444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 37/66] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:30:19.229569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.239141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60b0029c-c0e6-455b-bbf3-de8d54f68be1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.247611 Sep 11 05:30:19.239985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 30/67] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:18 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:19.274373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:19.275323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:19.283966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.284645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.285251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.286063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.286600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.287097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.439785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.448211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-757d7fdb-0f37-47cd-855b-cc623bab6697 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.178274 Sep 11 05:30:19.449108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 38/68] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:19 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:19.703663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:19.704458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:19.711724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.712399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.712913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.713732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.714295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.714922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.785778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:19.793863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbbb2788-b614-46ba-b761-3ac7890ecd0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.094695 Sep 11 05:30:19.796134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 31/69] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:19.959062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:19.959791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:19.965847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.966340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.966773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:19.967644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:19.968128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:19.968544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.094359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:20.095669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:20.102367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=44 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:20.104543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.105098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.105740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.106812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.107432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.108854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.198612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.208220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f437fd8c-375b-4aee-aac6-c5782a482fb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.253525 Sep 11 05:30:20.209516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 39/70] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:20.229505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.245348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.247091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.248263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63a94d7b-4d32-4e26-9eb3-6510a28d03f5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.159909 Sep 11 05:30:20.252040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 32/71] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:20.265969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:20.267273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:20.274665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.275615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.276450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.278141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.278828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.279458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.449110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.463619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-349a0d8c-1aa3-4394-8a44-1209f758aa6a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.204407 Sep 11 05:30:20.465032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 40/72] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:20 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:20.485878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:20.486835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:20.492995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.493794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.494460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.495464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.496328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.497398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.660908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.676363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8166c64c-a669-4abd-bcbf-358cf55944ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.191046 Sep 11 05:30:20.677223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 33/73] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:20 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:20.817093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:20.818115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:20.824751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.825374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.825917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.827254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:20.828043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:20.828585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:20.893842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:20.901582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a44057eb-9cb6-4a6c-ab47-f686b59ea1bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.088664 Sep 11 05:30:20.902141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 41/74] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:21.234990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:21.236426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:21.243735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.244772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.244772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.245309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.245923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.246635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.274755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:21.275349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:21.297748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.298245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.300330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.301067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.301525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.302107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.375122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.383422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.384895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.386002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d710427-cfee-4a97-9bf7-fd67d640f904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.115174 Sep 11 05:30:21.386564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 42/75] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:21.401274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.409531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e87c1cc-e886-4b95-bc59-55d8c134991e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.178742 Sep 11 05:30:21.410148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 34/76] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:21.487940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:21.488762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:21.495107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.495607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.496166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.497098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.497538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.498027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.647503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.658794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46a736f7-5e28-4d22-a966-c638abb1c6e9 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.174179 Sep 11 05:30:21.660291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 43/77] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:21 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:21.701442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:21.702670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:21.711823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.712572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.713225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.714158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.714720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.715215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.865059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:21.876214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-866dc279-75fe-4afc-aeb8-05e260e24d8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.178447 Sep 11 05:30:21.876820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 35/78] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:21 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:21.934225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:21.935015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:21.941325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.942085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.942776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:21.943470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:21.943935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:21.944382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.025644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.034965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fead78cd-285b-4ae9-8870-57ff22f225ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.112508 Sep 11 05:30:22.035539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 44/79] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:22.412428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:22.413031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:22.420278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.421280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.421928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.422775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.423238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.423663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.434197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:22.435365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:22.442594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.443419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.444318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.445245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.445866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.446537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.499153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.508444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.509911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.511015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b7789c2-cf90-4cd2-a544-aeb289ce9499 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.102867 Sep 11 05:30:22.511565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 36/80] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:22.630967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.639840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dfe349cb-bf98-420a-8d7e-13c8d1027aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.209716 Sep 11 05:30:22.640461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 45/81] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:22.684796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:22.685540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:22.692225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.692820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.693386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.694314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.694850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.695510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.903110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:22.912602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:22.912946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:22.922910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.923414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.923854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.924641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:22.925088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:22.925507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:22.926740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f1067e7-38e5-4bff-8a73-b492fe643057 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.245798 Sep 11 05:30:22.935057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 37/82] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:22 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:23.066406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:23.068425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:23.084362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.084987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.087963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.088738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.089201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.091567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.183879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.198740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf8c2175-408c-421a-ad10-170b7f03c1cc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.142391 Sep 11 05:30:23.199298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 38/83] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:23.208625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.216256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ecd4a67b-f612-4361-8d05-96214adefcc3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.317090 Sep 11 05:30:23.216817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 46/84] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:22 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:23.537190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:23.537793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:23.544724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.545291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.546515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.547286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.547824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.548401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.565181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:23.617470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.626490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.627944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.629134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-658664c8-1c29-4eb8-8b3a-e7c17a826fdc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.095963 Sep 11 05:30:23.629692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 39/85] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:23.662723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:23.663736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:23.669567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.670055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.671051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.672040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.672496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.672955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.838743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:23.847812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e496ecd2-a4b9-4aaf-83bb-7aee6fe6172c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.188890 Sep 11 05:30:23.848830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 47/86] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:23.959096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:23.959962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:23.975232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.980071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.980544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:23.981236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:23.981893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:23.983190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.135602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.144095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8038107-11e8-4855-86a0-16015a31c60a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.188757 Sep 11 05:30:24.144855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 40/87] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:23 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:24.225720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:24.226739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:24.235354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.235848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.236336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.237030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.237478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.237891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.240258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:24.241428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:24.249751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.250559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.251340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.252297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.252967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.253587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.310286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.320490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-98c2af4d-e0ef-4360-be9e-857ca9d56695 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.100819 Sep 11 05:30:24.321068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 48/88] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:24.423281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.430829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-235a5528-ec50-4ecb-bf61-6f2cfb009cd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.194456 Sep 11 05:30:24.431591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 41/89] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:24 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:24.655340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:24.662064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:24.670530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.672142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.672865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.679133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.679834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.680501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.753674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.762227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.765156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:24.766262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6ac9e1d-0bea-4fd7-8bff-f4e674bcb3ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.115708 Sep 11 05:30:24.766820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 49/90] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:24.875279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:24.875813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:24.882471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.883229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.883666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:24.884379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:24.884835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:24.885257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.058070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.075824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-621cbb36-2a9c-4b79-9323-4c183ffee12b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.204877 Sep 11 05:30:25.077444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 42/91] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:25.166741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:25.167342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:25.175419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.176232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.176866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.177971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.178676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.179300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.343952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:25.344630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:25.354993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.356269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.356783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.358707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.359533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.360040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.360680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.370725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28f7b706-15c7-4e97-a89e-e2f520f2f136 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.207833 Sep 11 05:30:25.372446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 50/92] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:25 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:25.435375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.444150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39e53b45-66de-4fc1-8e93-be10da5f5b84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.105170 Sep 11 05:30:25.444713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 43/93] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:25.464902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:25.465519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:25.476704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.478888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.481086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.482033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.484437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.486643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.655944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.663971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d411fe7c-52e4-4e0e-9a71-e9f119a0cfdf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.213677 Sep 11 05:30:25.664571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 51/94] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:25 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:25.792482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:25.793193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:25.796744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:25.801856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.802349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.803088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.803730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:25.804415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:25.804922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:25.874960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.886168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.887989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:25.889567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29acf32d-2518-470f-99b1-fb6c31494e29 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.102098 Sep 11 05:30:25.890572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 44/95] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:26.098883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:26.099516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:26.105313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.105792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.106221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.106906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.107354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.108445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.253817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.262873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5aac4dc0-6e50-4a63-9f0c-4c2b77e5c852 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.167651 Sep 11 05:30:26.263895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 52/96] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:26.394816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:26.395433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:26.401411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.401928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.402367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.403055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.403533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.403945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.466849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:26.467912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:26.473809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.474325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.474757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.475447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.475896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.476341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.536668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.538713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.544408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ed4f4a1-4ca0-417b-8bd3-65482886a798 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.153481 Sep 11 05:30:26.544971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 45/97] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:26 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:26.547123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0967b2b-4003-44d5-8518-e75ac2a8d237 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.084176 Sep 11 05:30:26.547683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 53/98] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:26.686929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:26.687570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:26.693417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.693895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.694324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.694998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.695473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.695896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.827295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.834895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff01dd10-7428-41aa-8d44-ab3ed359995c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.152065 Sep 11 05:30:26.835460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 46/99] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:26 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:26.914503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:26.915114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:26.922546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.923033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.923464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.924263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:26.924745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:26.925157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:26.929223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:26.988076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.996181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.997627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:26.998847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0efb2dea-fbe1-4995-8ea6-241c381a1339 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.088138 Sep 11 05:30:26.999514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 54/100] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:27.286722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:27.287392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:27.293379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.293851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.294315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.294993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.295855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.296417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.434408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:27.442928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d58a2cb2-1198-4d71-97c9-11586a722ab6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.160044 Sep 11 05:30:27.443689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 47/101] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:27.568714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:27.569226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:27.569415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:27.569508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:27.575770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.576288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.576771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.576922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.577381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.577555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.577810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.578005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.578420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.578524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.578939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.579358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.651137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:27.662661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c22ee4c-e7a6-4c0d-ae92-d6232d05b1f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.097538 Sep 11 05:30:27.668703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 48/102] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:27.740088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:27.750893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d018f81-4312-44e0-a815-d9c474efcb54 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.186259 Sep 11 05:30:27.751478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 55/103] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:27 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:27.858723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:27.859687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:27.870022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.870521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.870956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:27.871653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:27.872292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:27.872891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.024365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:28.025021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:28.036954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.037452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.037893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.038586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.039029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.040609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.146862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:28.163880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2b7a99e-1403-464b-8abe-9c7b6212227b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.309140 Sep 11 05:30:28.165469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 49/104] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:27 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:28.236997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:28.250975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:28.252959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:28.255761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c340fefd-df38-4ee6-929b-8543150a8b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1277 microversion: 2.20 time: 0.234578 Sep 11 05:30:28.256545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 56/105] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:30:28.468914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:28.470378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:28.477330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:28.481504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.482338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.483868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.485135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.485812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.486565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.690352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:28.691704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:28.705301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.708204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.709265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:28.710982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:28.713022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:28.714296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.040362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:29.058877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b87bf9af-0a32-4436-96ef-c597663d0d80 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1295 microversion: 2.1 time: 0.369569 Sep 11 05:30:29.072031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 57/106] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1295 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:29.072031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:29.072031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:29.088666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.089708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.090349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.091087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.091860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.092705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.222863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:29.256413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d02606ce-b62d-4130-abef-e1ad8fc78c06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.792424 Sep 11 05:30:29.262033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 50/107] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:29.280454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:29.281770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:29.293842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.297013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.298564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.300356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.301228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.316236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.747563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:29.766615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7466de6f-c8b2-4224-b5de-4a7f17976556 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.696998 Sep 11 05:30:29.772228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 58/108] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:29 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:29.820669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:29.823531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:29.845710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.848775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.849349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:29.851613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:29.855102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:29.855781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:30.382506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:30.400023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:30.400023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:30.400413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd01b5cc-a37e-4abc-9395-219fcbfe2352 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1351 microversion: 2.20 time: 0.626603 Sep 11 05:30:30.400910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 59/109] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1351 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:30.406644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:30.407252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:30.414687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:30.415179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:30.415702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:30.416479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:30.417545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:30.418510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:30.627565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:30.662538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f367c168-436e-4714-80cb-9ffbcff7c20b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 1.398882 Sep 11 05:30:30.663521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 51/110] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:29 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:30.669152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:30.669886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:30.677104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:30.678006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:30.679620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:30.680531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:30.681279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:30.682896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:31.078886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:31.096543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba112e03-e001-4d2a-abcd-88c25af45b1a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.694423 Sep 11 05:30:31.098678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 60/111] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:31.108658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:31.109687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:31.122425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:31.123193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:31.124822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:31.126017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:31.126685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:31.127420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:31.475702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:31.496836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e00584c8-c384-4ec1-b0da-1052c61eba4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.828601 Sep 11 05:30:31.511936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 52/112] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:31.648419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ab1d7c-7832-4c37-9d94-7f5ed0c8be89", "tag": "0aed7b13-2c7e-459b-93dd-179ad088a48e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:31.670991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:31.672809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:31.673334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:31.701973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] Creating event network-changed:0aed7b13-2c7e-459b-93dd-179ad088a48e for instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 on hv-cinder-85692 Sep 11 05:30:31.714921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-729f8930-996a-487a-9e72-b61066e46cd8 req-b6f9af66-bc32-468c-8196-5ee1f9029fe8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215576 Sep 11 05:30:31.720391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 53/113] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:31.731073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:31.733473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:31.749231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:31.749787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:31.750216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:31.756704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:31.757455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:31.758509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.059428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.066453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.073918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.077369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.080795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b310e160-ad4a-4ec5-aae2-4025684e851c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1339 microversion: 2.20 time: 0.359042 Sep 11 05:30:32.081991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 54/114] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:32.083848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd433be7-cb96-4101-b403-172055ea8572 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.980916 Sep 11 05:30:32.088088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:32.088880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:32.102878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 61/115] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:31 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:32.111729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.112260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.113315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.114376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.115827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.116755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.127481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:32.127937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:32.138300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.138746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.140352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.141279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.141542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.141964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.298087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.307498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ac7b110-2c52-4d98-a566-0faf02d48b68 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.184875 Sep 11 05:30:32.308363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 62/116] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:32.520223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:32.521116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:32.529285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.529285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.530469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.531182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:32.531640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:32.532127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:32.685457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.700348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dcc4535f-efd6-42ed-8d3a-ecb05a257580 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.184477 Sep 11 05:30:32.701114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 63/117] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:32.704371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:32.717817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-467584a5-9d2c-4d8a-8e5b-41d52666c8e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.634109 Sep 11 05:30:32.719054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 55/118] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:32 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:33.109273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:33.110912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:33.121090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:33.121877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:33.122825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.124708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.126986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.129120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.132782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.133729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.142152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.143617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.144193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.147955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.148597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.150001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.488475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:33.491963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:33.501786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45ebd309-ca19-4f51-a98a-b5deb641af24 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.394155 Sep 11 05:30:33.503390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 56/119] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:33 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:33.511375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eca0a65-6128-4887-b447-6d6e1ddc91a5", "tag": "031a32c6-4003-4a83-b703-6d1367f35137"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:33.532048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.532387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.532935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.559377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] Creating event network-changed:031a32c6-4003-4a83-b703-6d1367f35137 for instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 on hv-cinder-85692 Sep 11 05:30:33.567013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-969452e3-ed6f-44b0-a3a1-5a0636651e3b req-0b937dd9-f638-40e7-aa6c-39ed0f27078b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059443 Sep 11 05:30:33.567013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 57/120] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:33.575655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:33.578605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:33.585490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.585490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.585490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.588922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.589458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.589895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.594583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:33.614400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:33.616696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:33.618397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69f538f4-8b6e-43ae-ba5c-e8ff2aa280b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.515661 Sep 11 05:30:33.619477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 64/121] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:33.728625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:33.729323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:33.739878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.740535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.741257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.742485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.743020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.743518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.790086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:33.804368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e9ec96c-a52b-43dc-a6b7-5a4370f147b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.236125 Sep 11 05:30:33.805240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 58/122] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:33.809947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:33.810502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:33.818400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.818888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.819324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:33.820090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:33.820776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:33.821489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.014959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:34.022938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:34.026399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5ed4966-39b2-49db-8ad9-71055191fe4a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.302553 Sep 11 05:30:34.029105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 65/123] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:34.034969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2efd4165-9e92-4c22-85e2-789a68e81210 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.228505 Sep 11 05:30:34.035543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 59/124] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:33 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:34.054576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd35efc-966f-4a5c-8049-f9db2416e615", "tag": "50bb4dca-38a6-47da-8dca-94698f43dd3d"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:34.075108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.075753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.077622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.099156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Creating event network-changed:50bb4dca-38a6-47da-8dca-94698f43dd3d for instance 3fd35efc-966f-4a5c-8049-f9db2416e615 on hv-cinder-85692 Sep 11 05:30:34.099911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 05:30:34.100469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7e222eda-b4ca-4f8f-9679-6242c638c13e req-38978151-a9ec-443f-a6ae-0ff0ef7e7688 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 05:30:34.101644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.102252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.102847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.103700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.104321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.104880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.119010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.compute.rpcapi [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 05:30:34.121989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 05:30:34.140765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3e7f198-addf-45c6-ac41-6d51c909d0d0 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108933 Sep 11 05:30:34.141368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 66/125] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:34.532239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:34.533092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:34.546637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.547162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.547611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.548385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.548850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.549271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.651846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:34.657095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:34.678013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.678656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.681905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.684514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:34.685153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:34.695101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:34.969104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:34.986285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41045650-0361-4d92-8c29-d8622ebd5d72 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.461227 Sep 11 05:30:34.993826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 60/126] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:34 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:34.999651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:35.016179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:35.030548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.031378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.032071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.034976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.037197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.037910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.172312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.186884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.196306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.197894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a290ad61-3c18-439e-903a-a44401e7fdef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.552590 Sep 11 05:30:35.212037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 67/127] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:35.222284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:35.223121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:35.230844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.231639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.232343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.236253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.237012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.237673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.583233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.595555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da7e27fa-c091-4298-9226-64c51417b409 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.600275 Sep 11 05:30:35.597599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 61/128] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:35.608537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:35.613189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:35.626834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.632620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.633230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.633891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.635193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:35.635991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:35.636623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:35.648274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-298755ed-ec26-4ddf-aa17-bf29bf690a2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.433656 Sep 11 05:30:35.649172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 68/129] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:35.895192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:35.902990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90c6b42d-d365-4bc2-8958-a5ef26e552be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.303242 Sep 11 05:30:35.906298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 62/130] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:35 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:36.027694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:36.029972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:36.036520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.046388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.047290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.048536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.049253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.050503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.227071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:36.233746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:36.250448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.250951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.251384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.264608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.265592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.266047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.361524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:36.377571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fb6dc2d-92c7-4d84-9589-6a8dbb9528bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.363194 Sep 11 05:30:36.378766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 69/131] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:36 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:36.558300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:36.575455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.578054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.578769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.604989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] Creating event network-changed:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:30:36.621607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-c2f44190-6e44-4b4b-af8d-f4fb6a4b1493 req-cf6217a6-08ab-4ac9-86a7-b04f2f6fce45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067253 Sep 11 05:30:36.625093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 70/132] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:30:36.634228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:36.634763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:36.644210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.644860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.645301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.645995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.646764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.647330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.691279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:36.705874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:36.707521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:36.708901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5480fe2d-a11e-4021-a90a-56e7fb65893c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.485932 Sep 11 05:30:36.720932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 63/133] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:36.726322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:36.727000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:36.734632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.735925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.736266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.736988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.737599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.738044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.875962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:36.881301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:36.890848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4199db90-594c-4a4a-913d-815f6072e600 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.264050 Sep 11 05:30:36.891783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 71/134] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:36.931647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:36.933238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:36.949567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.950390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.953644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.954983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:36.955602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:36.956217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:36.997146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:37.015414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d11aa71-1abd-4fb2-ba4b-e9775af6823e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.293353 Sep 11 05:30:37.017342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 64/135] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:37.404555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:37.407312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:37.455287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:37.460253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.460753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.466871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4977337a-9a4f-472f-be49-3c869d1ab739 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.539546 Sep 11 05:30:37.467476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:37.469605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.470402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.472300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 72/136] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:36 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:37.472599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:37.739532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:37.741664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:37.762722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.763485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.766641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:37.767537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.768213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.768774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:37.856257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:37.864832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03049075-93c8-44f0-98d4-52bf1a659350 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.465766 Sep 11 05:30:37.869837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 65/137] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:37 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:37.919343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:37.921889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:37.939249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.940849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.942112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:37.943020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:37.943633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:37.944329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.023067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.053207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.071980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.077512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-048be02d-c340-4b94-b041-219d525f74cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.346547 Sep 11 05:30:38.081852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 73/138] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:30:38.105704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:38.112125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:38.127250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.132528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.140641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.143151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.144945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.145551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.461810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.471342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-524e054e-6ff8-41f0-a460-f6b0441fa683 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.385982 Sep 11 05:30:38.472815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 74/139] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:38.474673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.489810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b813396-4eef-4a98-befe-34934b16a708 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.578057 Sep 11 05:30:38.490395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 66/140] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:38.503655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:38.505195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:38.521054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.522167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.522822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.523766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.524467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.526207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.721994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:38.725040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42e41e9-5297-4be5-a77d-6558fdb3b01f", "name": "network-vif-plugged", "status": "completed", "tag": "de1a56c3-9f13-4434-afbc-573439a20fe3"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:38.738052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3363d7a0-67d3-492b-8c47-3f90159866fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.244520 Sep 11 05:30:38.739207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 67/141] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:38 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:38.742721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.744515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.745771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.781209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] Creating event network-vif-plugged:de1a56c3-9f13-4434-afbc-573439a20fe3 for instance c42e41e9-5297-4be5-a77d-6558fdb3b01f on hv-cinder-85692 Sep 11 05:30:38.798599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-d72b874b-f5a7-49a3-8876-b22f8b7a0e89 req-6d1c9356-b538-44b2-88ff-07b8ebf64f0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323752 Sep 11 05:30:38.799634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 75/142] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:38.895257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:38.895870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:38.908679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.909835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.910849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:38.913184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:38.913866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:38.914291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.101172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:39.111361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:39.112270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:39.122093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efd44402-cc69-488f-b287-c7af18178f85 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.230250 Sep 11 05:30:39.124134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 68/143] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:38 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:39.137172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.138217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.139135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.140344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.141015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.141807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.337283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:39.366244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:39.367897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:39.369997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47b4fb8b-8365-413e-8d79-571893585e35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.264007 Sep 11 05:30:39.371131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 76/144] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:39.495098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:39.496293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:39.505683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.517549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:39.518260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:39.521499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.524178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.524946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.526765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.527441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.528056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.532402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.535015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.535968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:39.536673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:39.538330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:39.987755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:40.000109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9b0f213-9748-4f47-99d5-e9ce1599993d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.506826 Sep 11 05:30:40.001116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 69/145] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:40.010543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:40.013841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:40.028053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.028752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.030712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.031623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.034127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.034706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.128559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:40.143368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d865613a-c5a7-4cf7-acce-fa4ddf593ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.630675 Sep 11 05:30:40.157253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 77/146] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:40.167130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:40.168044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:40.175247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.176025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.176707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.178186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.179078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.179983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.716296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:40.724971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e23b086-8c9e-4c91-8f33-8c15dab00133 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.722246 Sep 11 05:30:40.726002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 70/147] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:40 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:40.738512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:40.739838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:40.748553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:40.749388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.750329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.751190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.752359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:40.753051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:40.753763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:40.761400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-574ecaa0-47a5-49a1-8d51-73ed4d03b4f8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.602891 Sep 11 05:30:40.762883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 78/148] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:40 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:41.035098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:41.036151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:41.043544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.043843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.044405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.045946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.046621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.047269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.147027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:41.157747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:41.159713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:41.161237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d8af1a7-9e37-4f3b-8275-ade16f885fbd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.434053 Sep 11 05:30:41.162011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 71/149] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:41.187004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:41.187974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:41.195909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.196694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.197852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.199475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.200536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.201985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.304286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:41.313917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29c48fb7-89f5-4cab-893d-920cc0a1eaaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.292361 Sep 11 05:30:41.315256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 79/150] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:41.433687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:41.442589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c9197bf-7e7b-47dc-8004-699f83de1cec tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.261746 Sep 11 05:30:41.443274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 72/151] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:41.750554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:41.751773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:41.762439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.763032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.763477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.764734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.765198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.765625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.785571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:41.786405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:41.820415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.820923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.822244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:41.823808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:41.824301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:41.831882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.026651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.046782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5c89216-ba5f-42ef-a5a0-79fcee3268d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.300694 Sep 11 05:30:42.047630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 80/152] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:41 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:42.065318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0651b94-3604-4b72-8562-7b252652c725", "name": "network-vif-plugged", "status": "completed", "tag": "7b14db7f-83e7-446e-8ada-d567e4c34601"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:42.067951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.078166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a2061f5-5662-4704-9863-607b44070d7f tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.296160 Sep 11 05:30:42.091449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 73/153] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:41 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:42.092510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.093122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.093689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.108773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] Creating event network-vif-plugged:7b14db7f-83e7-446e-8ada-d567e4c34601 for instance f0651b94-3604-4b72-8562-7b252652c725 on hv-cinder-85692 Sep 11 05:30:42.116330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-dcc3664e-5809-4dc9-a8f5-a7fbfb753577 req-f71d6596-54d4-40d4-bbf7-01a535bc3339 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062026 Sep 11 05:30:42.117194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 81/154] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:42.187487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:42.188232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:42.202130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.202830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.203615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.204700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.205313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.205736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.208932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:42.339205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:42.340196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:42.351543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.352070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.355051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.355782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.356458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.356894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.395143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.409607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.415061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.417048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a877dd94-1fe0-41ae-b15f-2974cc20119b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.234172 Sep 11 05:30:42.418266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 74/155] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:42.469726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:42.470858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:42.478440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.479112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.480079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.480942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:42.481543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:42.482124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:42.570662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.583459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a49e9f8-2ec0-4a54-8999-881f3d0d1a25 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.248459 Sep 11 05:30:42.597038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 82/156] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:42.656859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:42.666035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48d13a3c-5158-42ef-8f42-1c5ae1b7b933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.204886 Sep 11 05:30:42.666599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 75/157] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:43.075069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:43.075069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:43.080484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.080974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.081423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.082114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.082565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.082990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.102791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:43.103401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:43.111664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.112189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.112631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.113328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.113784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.114203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.279755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.289249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b30c6a6c-324c-44d6-9c79-1951be64987c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.220079 Sep 11 05:30:43.299623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.309853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 83/158] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:43 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:43.311066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a79200c-100f-47c1-beba-fdd3176b6232 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.211826 Sep 11 05:30:43.311756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 76/159] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:43 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:43.441976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:43.442758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:43.457777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:43.459407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.459942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.460406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.461108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.461559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.462171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.608048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:43.608750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:43.615352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.616039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.616647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.617503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.618161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.618728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.634775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.665827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.670884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.673370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de23b475-cbbf-4624-bb8d-8dd2078515ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.235566 Sep 11 05:30:43.676524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 84/160] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:43.692947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:43.693560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:43.706067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.706700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.707144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.707935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:43.708420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:43.709230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:43.900207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:43.908741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a3a8198-2111-42b4-853f-6ee8258ad8ed tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.221778 Sep 11 05:30:43.909311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 85/161] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:44.053044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.061442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7844a52a-3a8e-4cc1-b4d4-7b835f481899 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.456593 Sep 11 05:30:44.062025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 77/162] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:44.317857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:44.318572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:44.328312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:44.333916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.335011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.336565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.338181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.338927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:44.339655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:44.342354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.343056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.350908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.352777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.359053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.359981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.360727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.361269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.536555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.549802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09f4ade9-8a45-4748-88e3-6c56f65016c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.236142 Sep 11 05:30:44.560058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 86/163] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:44 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:44.701735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:44.702738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:44.709660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.710262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.710816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.711822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.714353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.714799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.838689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.854259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff3b2588-0942-4b45-b174-fc21d2c2d22e tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.519492 Sep 11 05:30:44.855603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 78/164] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:44 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:44.885513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.894583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.896026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:44.897147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a9cedb6-4813-4130-bec7-5ae8fc59334e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.199947 Sep 11 05:30:44.897706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 87/165] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:44.932622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:44.933359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:44.939568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.940094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.940531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:44.941317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:44.941774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:44.942282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.076557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:45.083873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:45.084638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:45.086276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27c755d7-3c4f-4abb-b3ed-1b941bda40f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.157323 Sep 11 05:30:45.087049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 79/166] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:45.090872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.091359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.092433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.093130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.093625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.094053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.239805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:45.249370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-598e82f4-fce0-47a6-ae6b-1a86bc577c76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.169348 Sep 11 05:30:45.250288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 88/167] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:45.575049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:45.575673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:45.582899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.583393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.583830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.584549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.585415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.586234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.756774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:45.768075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62643ecc-8432-4148-8124-d7c0cd85d29d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.196470 Sep 11 05:30:45.768672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 80/168] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:45 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:45.891672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:45.891672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:45.891672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.891672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.892458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.892458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.892458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.892458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.923500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:45.924344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:45.936619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.937563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.938382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:45.939704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:45.940210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:45.942969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.074091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.079292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:46.085556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e94659e-02dc-403b-98f4-d78ae0ade29c tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.209855 Sep 11 05:30:46.086845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 89/169] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:45 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:46.110918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:46.111619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:46.118150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.118714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.119221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.120035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.120560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.121190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.125234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.135362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.136880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.138142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efda77c3-2d17-4cfc-b05c-b7e850ad6436 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.218571 Sep 11 05:30:46.138867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 81/170] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:30:46.262113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.270446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbb0608f-3d3f-45e2-8416-d16c097e6161 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.163641 Sep 11 05:30:46.271273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 90/171] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:46.273374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:46.273990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:46.280773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.281262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.281695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.282419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.282869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.283288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.423158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.432028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-742bd614-9171-4cf8-a57d-e5439d032eee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1367 microversion: 2.1 time: 0.162436 Sep 11 05:30:46.432771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 82/172] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:46.792464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:46.793151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:46.800512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.801232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.801741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.802982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:46.803687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:46.804229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:46.941732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:46.949670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c4bdf60f-4a3a-468d-a70e-3d5bbc613711 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.161345 Sep 11 05:30:46.950232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 91/173] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:46 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:47.109011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.110016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.115905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.116444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.116881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.117580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.118036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.118462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.165312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.166005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.173924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.174857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.175388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.176346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.177229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.177978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.425734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.434338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34d2ddc7-a63d-4c97-afab-0c8e384f18c1 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.329706 Sep 11 05:30:47.438761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 83/174] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:47.446187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.447464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.454953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.455448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.455877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.456735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.457331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.457689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.483934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.492939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.494482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.495662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56e5931b-6966-4d89-a506-2f2fc9a586a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.335222 Sep 11 05:30:47.496637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 92/175] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:47.502329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.503134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.509545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.510213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.510642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.511489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.511946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.512424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.625366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.648859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac7e973e-f9e1-4011-ac11-c83d07b565c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.208500 Sep 11 05:30:47.649459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 84/176] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:47.667276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:47.677772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f4ce57a2-eb88-443f-afed-d9627996107d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1556 microversion: 2.1 time: 0.179468 Sep 11 05:30:47.678368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 93/177] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:47.703679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.704575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.714461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.715260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.715870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.717648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.718478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.719102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.856155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e61c5a9-6491-41c7-9e5f-650cc3c03efe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158146 Sep 11 05:30:47.856884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 85/178] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:47.973831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:47.974955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:47.981665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.982610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.983228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:47.984204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:47.984660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:47.985091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.124135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd35efc-966f-4a5c-8049-f9db2416e615", "name": "network-vif-plugged", "status": "completed", "tag": "50bb4dca-38a6-47da-8dca-94698f43dd3d"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:48.151815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.152935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.154089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.182089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] Creating event network-vif-plugged:50bb4dca-38a6-47da-8dca-94698f43dd3d for instance 3fd35efc-966f-4a5c-8049-f9db2416e615 on hv-cinder-85692 Sep 11 05:30:48.193686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fdbc4e20-199b-49ca-99f3-7586de765210 req-bedf3df0-ba95-4dcd-8e4f-7d07ce46bbcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072071 Sep 11 05:30:48.196662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 86/179] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:30:48.275650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.283763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec767998-bd8d-428c-91c8-a80537ac9dc7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.313596 Sep 11 05:30:48.288366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 94/180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:47 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:48.463612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:48.464584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:48.499278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.499768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.500617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.501337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.501796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.502226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.524842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:48.526129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:48.536398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.537148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.538143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.539662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.540361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.540883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.643016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.650753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ed09bcd-1644-427c-923c-d75b7ddd06ad tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.192346 Sep 11 05:30:48.651315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 87/181] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:48 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:48.677195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:48.677800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:48.683953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.684493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.684971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.686382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:48.687059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:48.687652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:48.850886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.861572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c1d1052-f69d-46b4-b490-2478c53dad56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.187970 Sep 11 05:30:48.862633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 88/182] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:48.906664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.918638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.922072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:48.939222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df3733c9-82c1-4efb-98ca-6f6367ebc38f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.418441 Sep 11 05:30:48.945894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 95/183] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:49.314030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:49.314803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:49.321434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.322554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.323602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.324720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.326136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.326890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.532920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:49.546264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bde08560-84ed-4465-aa8f-249a965d78d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.236503 Sep 11 05:30:49.547543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 89/184] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:49 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:49.660274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42e41e9-5297-4be5-a77d-6558fdb3b01f", "tag": "de1a56c3-9f13-4434-afbc-573439a20fe3"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:49.670547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.671347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.671775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.674449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:49.675138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:49.682533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.683311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.683902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.684798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.685464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] Creating event network-changed:de1a56c3-9f13-4434-afbc-573439a20fe3 for instance c42e41e9-5297-4be5-a77d-6558fdb3b01f on hv-cinder-85692 Sep 11 05:30:49.685873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.686563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.691336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-554f39f4-6b8a-4fa7-b5bb-c008279ef350 req-e76ac3cc-f4c3-4c90-b30c-31697d31a041 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034638 Sep 11 05:30:49.691924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 96/185] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:49.852237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:49.861554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-206388ee-6fb4-4ebc-a67e-d14c5ecb4744 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.192086 Sep 11 05:30:49.862362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 90/186] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:49 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:49.887251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:49.888265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:49.895680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.896112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.896736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.897605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.898068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.898491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.965803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:49.966952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:49.975048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.975752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.976472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:49.977432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:49.978012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:49.978541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:50.051622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:50.062707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b34c7dc8-66d3-4395-9f4f-f7959698ad8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.177444 Sep 11 05:30:50.066038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 97/187] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:50.135914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:50.138221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:50.147335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:50.148828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:50.149953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cdd4344-2796-4918-8eb2-15645544dc09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.188673 Sep 11 05:30:50.150514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 91/188] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:50.253507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ab1d7c-7832-4c37-9d94-7f5ed0c8be89", "name": "network-vif-plugged", "status": "completed", "tag": "0aed7b13-2c7e-459b-93dd-179ad088a48e"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:50.264240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:50.265077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:50.265658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:50.277057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] Creating event network-vif-plugged:0aed7b13-2c7e-459b-93dd-179ad088a48e for instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 on hv-cinder-85692 Sep 11 05:30:50.282756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-ee1592b9-189c-44fd-b19c-f6167c796e87 req-a4c53f4e-96aa-4d4e-9d65-eab15f3fe47e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Sep 11 05:30:50.283698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 98/189] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:50.573688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:50.575256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:50.591021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:50.591747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:50.592216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:50.593113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:50.593939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:50.594861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:50.767153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:50.778515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-994dca97-5da5-4853-affa-2eb3cc12be3e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.212563 Sep 11 05:30:50.781094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 92/190] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:50 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:50.887154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:50.888714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:50.896709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:50.897275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:50.897712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:50.898410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:50.898860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:50.899279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.072707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.082616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6abb14f2-e074-4599-9cc7-90421ac5e4f4 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.201210 Sep 11 05:30:51.083601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 99/191] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:50 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:51.089432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:51.090440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:51.097144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.097855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.098331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.099178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.099796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.100551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.176645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:51.177467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:51.187244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.188054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.188656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.189425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.190037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.190474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.285454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.295919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4141baae-f875-494e-853e-3abba789ac31 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.212951 Sep 11 05:30:51.308042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 93/192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:51.377896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.386849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.389016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.390205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d692b056-b313-4989-ba88-d44138847815 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.219152 Sep 11 05:30:51.391103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 100/193] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:51.804951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:51.807376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:51.814005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.814486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.814916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.815600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:51.816074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:51.816499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:51.954445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:51.961094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-252abe91-c488-4785-bfd7-80502811622e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1322 microversion: 2.1 time: 0.159837 Sep 11 05:30:51.962405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 94/194] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:51 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:52.106736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:52.108255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:52.115492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.116736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.117310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.118115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.118659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.119176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.267730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:52.282643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4cbf849-5014-4600-80dd-d04fdcba064a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.180260 Sep 11 05:30:52.283621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 101/195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:52 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:52.310662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca0a65-6128-4887-b447-6d6e1ddc91a5", "name": "network-vif-plugged", "status": "completed", "tag": "031a32c6-4003-4a83-b703-6d1367f35137"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:52.324064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.324287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:52.324826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:52.325021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.325462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.333563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.334148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.335028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.335634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.336261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.338765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] Creating event network-vif-plugged:031a32c6-4003-4a83-b703-6d1367f35137 for instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 on hv-cinder-85692 Sep 11 05:30:52.344764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b403f4cb-6c2c-4ea2-89d2-917a36d975a6 req-8bd76ea0-f382-4918-9064-284c30fdc7fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038092 Sep 11 05:30:52.349591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 95/196] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:52.430538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:52.431803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:52.440590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.441664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.442303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.443189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.443795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.444399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.595188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:52.604551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ab5913d-4b4c-441d-b263-02899f957397 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.284394 Sep 11 05:30:52.605137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 102/197] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:52.791526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:52.803125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:52.805031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:52.806477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501a7769-8f13-4d0c-8d87-084a85c5d9e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.383351 Sep 11 05:30:52.807096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 96/198] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:52.986165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:52.988131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:52.995539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.996043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.996485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:52.997184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:52.997644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:52.998069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.146993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:53.155429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-95252194-f3b8-4505-9948-4d9de46be88c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1517 microversion: 2.1 time: 0.174377 Sep 11 05:30:53.157389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 103/199] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:52 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:53.181697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:53.184414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:53.190643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.191133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.191810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.192555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.193019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.193448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.223901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'flavor' on Instance uuid f0651b94-3604-4b72-8562-7b252652c725 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:30:53.313357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:53.314254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:53.327201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.327701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.328346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.329130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.329652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.330133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.406546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-611f3e98-62b3-410a-aa2d-fa1ff1e11254 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725/action" status: 200 len: 32 microversion: 2.1 time: 0.228632 Sep 11 05:30:53.412248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 97/200] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:30:53 2022] POST /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 05:30:53.420861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:53.422096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:53.429775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.430549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.430984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.431687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.432316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.432887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.562633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:53.580229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a10b0edf-e250-4eaf-8442-013e42ebdc50 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.271314 Sep 11 05:30:53.580894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 104/201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:53 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:53.634931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:53.635626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:53.642786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.643280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.643718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.644449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.644905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.645345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.666032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:53.675351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f2ce506-f68d-4ec5-b1c8-113a6a3e045d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.260410 Sep 11 05:30:53.676038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:53 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:53.784211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:53.791980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82ec9fac-4d12-4fad-bb2e-f0e220d2a771 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.161654 Sep 11 05:30:53.804446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 105/203] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:53.834101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:53.845904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:53.858288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.858781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.859215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.859951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:53.860448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:53.860871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:53.992498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:54.001450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:54.003122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:54.004378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13a86af9-625b-4adc-a5d8-9d4bf7eb3dbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.174758 Sep 11 05:30:54.004939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 99/204] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:54.604361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:54.604969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:54.611493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.612092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.612506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.613249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.613639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.614129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.698971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:54.699835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:54.711859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:54.713921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.714737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.715597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.718493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.721165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.721165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.762911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:54.772899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7db92b5-4745-4571-bd9a-c2e397188d2a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.172217 Sep 11 05:30:54.779104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 106/205] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:54 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:54.819537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:54.820356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:54.830324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.830812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.831424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.832154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:54.832791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:54.833393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:54.908747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:54.918739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf761e8c-ba66-4839-882f-a4c02dbd8236 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.223730 Sep 11 05:30:54.919929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 100/206] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:54 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:55.009380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:55.014036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:55.021724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-211861b0-c059-4494-bfff-d033108d0599 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.206369 Sep 11 05:30:55.023043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 107/207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:55.033718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:55.034314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:55.041564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.042365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.043095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:55.044112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.045164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.045651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:55.199011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:55.209642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:55.211090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:55.212229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9b2651f-f4a2-430c-83ea-27b6b212c60f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.183103 Sep 11 05:30:55.212787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 101/208] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:55.796470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:55.797738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:55.805504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.808292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.808758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:55.811954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.812655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.813088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:55.954105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:55.954819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:55.964842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.965465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.969661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:55.970580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:55.971518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:55.972141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.007344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.017918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5159584e-6d8f-423d-9dab-2cb34f1b2cda tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1314 microversion: 2.1 time: 0.226952 Sep 11 05:30:56.018494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 108/209] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:55 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:56.049119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:56.049732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:56.055874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:56.056408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:56.056847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.057549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:56.058005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:56.058426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.196757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.205316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6704da0-bac8-459e-8cb1-8af204f09e2f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.159872 Sep 11 05:30:56.206195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 109/210] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:56.238730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:56.239438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:56.245775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:56.246260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:56.246692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.247389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:56.248505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:56.249242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.330157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.339411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8768124c-4658-4efc-acf0-f879f28aa929 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.389628 Sep 11 05:30:56.340316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 102/211] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:55 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:56.382543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.392347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.394377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:56.395480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6dcb919-d8df-410a-94f8-5ae97841f71e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.161035 Sep 11 05:30:56.396069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 110/212] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:30:56.676108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "name": "network-vif-plugged", "status": "completed", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:56.687984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:56.689294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:56.689740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:56.701097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] Creating event network-vif-plugged:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:30:56.706857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-7668b875-75f4-4136-91c8-91ce2f53a28d req-5d8be783-8d23-4f7b-8aa1-886545cbc70c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Sep 11 05:30:56.707460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 103/213] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:57.046037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:57.046653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:57.052549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.053035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.053473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.054168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.054620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.055045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.187412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.195878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38d28203-06b6-4f13-b7c5-4747baf253cb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1500 microversion: 2.1 time: 0.154385 Sep 11 05:30:57.196487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 111/214] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:57 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:57.253875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:57.254754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:57.264346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.265431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.266309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.267300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.267917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.268368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.364591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:57.365171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:57.374914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.375902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.376533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.377446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.378219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.379114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.471189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.485813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2839e017-837d-4246-a391-12ab4cdb20dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1363 microversion: 2.1 time: 0.234976 Sep 11 05:30:57.498421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 104/215] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:57.506492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:57.507650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:57.514654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.515265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.515705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.516599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:57.517391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:57.517823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:57.583767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.593199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-04acf66a-709b-4a42-8e0d-b82fd6d58991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.233824 Sep 11 05:30:57.594894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 112/216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:57 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:57.676208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.684329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.686378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:57.687482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e265629a-a96e-4b75-926a-f2a53e4c2cf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.187580 Sep 11 05:30:57.688052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 105/217] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:58.510829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:58.511441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:58.517401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.517876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.518308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.518988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.519438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.519854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.618649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:58.619247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:58.625619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.626095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.626522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.627202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.627648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.628205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.652025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:58.663526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df4889b5-a124-4330-a396-1fbfa696293f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1549 microversion: 2.1 time: 0.156641 Sep 11 05:30:58.664032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 113/218] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:30:58.697247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:58.697740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:58.703775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.704318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.704753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.705433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.706048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.706472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.769373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:58.777679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4259cdac-608e-4117-81f4-a8ce2ff494c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.162818 Sep 11 05:30:58.784652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 106/219] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:58 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:30:58.785228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:58.786150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:58.791966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.792546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.793659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.796101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:58.796793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:58.797474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:58.826487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75263eb1-8e6f-4302-91df-eac2ffac0ba9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132988 Sep 11 05:30:58.827093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 114/220] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:30:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:30:58.943945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:58.946237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:30:58.955493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:58.956956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:30:58.958064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f265c4f-ce7b-429b-99cf-d75e94f5d658 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.177463 Sep 11 05:30:58.958618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 107/221] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:30:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:30:59.772999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2675c29-12ec-44ba-b48a-4f668b1b972e"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:30:59.775270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:59.782701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:59.783424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:59.784061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:59.784914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:59.785518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:59.786105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:59.803583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:30:59.804990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:30:59.814112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:59.820869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:59.821731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:30:59.823186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:30:59.824088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:30:59.825095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:00.056403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:00.067468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13a1c3f5-2681-442e-b9e0-9d714056a22f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.268397 Sep 11 05:31:00.068419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 108/222] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:30:59 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:00.073145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eca0a65-6128-4887-b447-6d6e1ddc91a5", "tag": "031a32c6-4003-4a83-b703-6d1367f35137"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:00.083231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:00.083971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:00.084619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:00.099142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] Creating event network-changed:031a32c6-4003-4a83-b703-6d1367f35137 for instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 on hv-cinder-85692 Sep 11 05:31:00.104502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c04a9492-cc3d-4f8c-bb0a-4fa29fb4dd16 req-3a0a609c-a145-495e-bfc4-0dd871679952 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 Sep 11 05:31:00.105208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 109/223] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:00.114617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:00.115617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:00.122020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:00.123446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:00.123914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:00.124699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:00.125149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:00.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:00.260465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:00.269388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:00.271053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:00.272241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-926f6b14-3004-4e11-b3d2-74cb3c9be804 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.161785 Sep 11 05:31:00.272805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 110/224] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:31:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:31:01.093984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:01.094666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:01.100839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:01.101327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:01.101765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:01.102460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:01.102913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:01.103353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:01.241510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:01.251405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-348964da-c332-4b4e-8afb-f463400342be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.161871 Sep 11 05:31:01.252259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 111/225] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:01 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:01.299611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:01.300320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:01.306412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:01.306963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:01.307484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:01.308657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:01.309210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:01.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:01.567055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58e684b1-6edf-4d7b-86fa-e607d4277cf8 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "POST /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.798127 Sep 11 05:31:01.568400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 115/226] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:30:59 2022] POST /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615/os-volume_attachments => generated 194 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:01.583679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:01.592729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:01.594507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:01.595821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a06fbc51-b0dc-4816-afb3-54414b36cdcd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.300572 Sep 11 05:31:01.596622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 112/227] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:31:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:31:02.282356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:02.287132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:02.305879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:02.306634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:02.307661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:02.308218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:02.308811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:02.309375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:02.503262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:02.511693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05fa76c7-ea54-4e09-9448-f4c5ebfb4f72 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.238086 Sep 11 05:31:02.512302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 116/228] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:02 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:02.620908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:02.621510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:02.628958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:02.629519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:02.629965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:02.630661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:02.631348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:02.631837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:02.860696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:02.869866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:02.871337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:02.873078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c3693b5-a0ca-4013-8d85-ae041e470503 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1407 microversion: 2.20 time: 0.255536 Sep 11 05:31:02.873718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 113/229] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:31:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:31:03.537241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:03.537832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:03.545408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:03.546472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:03.546906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:03.548056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:03.548515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:03.551978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:03.714333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:03.728731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7e86e241-9c77-4e04-8201-37196d48c52e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.195867 Sep 11 05:31:03.737238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 117/230] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:03 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:03.901467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:03.902078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:03.917485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:03.918543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:03.919229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:03.920634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:03.921470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:03.922121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:04.098980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:04.108899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:04.110864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:04.112310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91960441-9d6c-4399-b8c4-799b4d54cbf2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1598 microversion: 2.20 time: 0.215271 Sep 11 05:31:04.134923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 114/231] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:31:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1598 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:31:04.142797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:04.143650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:04.163627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:04.164229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:04.164743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:04.165515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:04.166184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:04.166673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:04.463977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dde2957d-554a-428b-aa60-3f0ebce11b78 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.326205 Sep 11 05:31:04.464671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 118/232] 10.222.0.33 () {60 vars in 1316 bytes} [Sun Sep 11 05:31:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:31:04.752542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:04.753146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:04.759780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:04.760300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:04.760744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:04.761879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:04.762348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:04.762777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:05.174911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:05.187295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-310aa94f-7b4b-4f1b-83d3-9c284822bf89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.438770 Sep 11 05:31:05.187983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 115/233] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:04 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:06.211354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:06.212883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:06.220637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:06.221126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:06.221561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:06.222450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:06.222913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:06.223334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:06.304016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-789741406", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:06.364570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] validate_networks() for None {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:31:06.375162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:06.382906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8156ea8-4007-403b-9a88-aacf3c352973 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.176073 Sep 11 05:31:06.383737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 119/234] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:06 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:06.578393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:06.588760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:06.589614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:06.590226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:06.602996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] Creating event network-changed:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:31:06.609059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-f194031b-d420-403e-bc6a-6675edd2ce7f req-7b12a7f8-df1d-4510-9985-b94b97623070 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035689 Sep 11 05:31:06.609760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 120/235] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:06.758087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:31:06.759029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:31:06.760130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:31:06.760907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:31:06.761551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:31:06.774575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:06.775216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:06.775721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:06.776625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:06.777164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:06.777659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:06.799033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Getting quotas for project 2a9ef16092824511b11494d4388e3c58. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:31:06.804388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Getting quotas for user b67b9e5012f34ab4a17ab579131a986e and project 2a9ef16092824511b11494d4388e3c58. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:31:06.818732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:31:06.821201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:31:06.870898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71a024ca-e227-4d88-98ae-283f614dbac7 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570812 Sep 11 05:31:06.871547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 116/236] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 05:31:06.883656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae345cb6-309f-4c33-a00d-55c4d82b8579 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:06.884679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae345cb6-309f-4c33-a00d-55c4d82b8579 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:06.967815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae345cb6-309f-4c33-a00d-55c4d82b8579 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:06.977141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae345cb6-309f-4c33-a00d-55c4d82b8579 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1214 microversion: 2.1 time: 0.097760 Sep 11 05:31:06.983563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 121/237] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:06 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:07.407523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:07.408338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:07.414540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:07.415037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:07.415476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:07.416385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:07.416843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:07.417276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:07.579667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:07.593851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0416a7ec-4b68-454b-a056-81331a5212ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.191025 Sep 11 05:31:07.605425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 117/238] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:07 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:08.006404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:08.007051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:08.014358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.015102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.015546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.016276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.016734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.017161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.078846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:08.086552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60404f8b-c272-405b-93d6-182f25f2b313 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1266 microversion: 2.1 time: 0.083994 Sep 11 05:31:08.087181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 122/239] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:08 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:08.378839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-926130235", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "networks": [{"uuid": "fbad63f1-f0e1-473d-9386-3e273d0de762"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:08.436495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] validate_networks() for [('fbad63f1-f0e1-473d-9386-3e273d0de762', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:31:08.618857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:08.619846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:08.627203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.628180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.628781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.629808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.630425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.631091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.778271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:08.786762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd43ffc4-8e0d-4e01-a03d-ca6564aaf1ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.171956 Sep 11 05:31:08.787425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 123/240] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:08 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:08.913727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:31:08.914128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:31:08.914593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:31:08.914993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:31:08.915401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:31:08.925339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.925825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.926257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.926967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:08.927418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:08.927834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:08.946808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Getting quotas for project 16e859bc783a445f9b951dd2363fa0ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:31:08.950612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Getting quotas for user 8424e74e566d4bf3b8840b5d5c20aa1f and project 16e859bc783a445f9b951dd2363fa0ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:31:08.961247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:31:08.963486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:31:09.011956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc3937ee-3cde-48f6-acf6-dd00b710f171 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636889 Sep 11 05:31:09.012628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 118/241] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:31:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:31:09.023792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0a83715c-c34d-42a8-a0c2-8fd887c34e50 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:09.024527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0a83715c-c34d-42a8-a0c2-8fd887c34e50 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:09.087431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0a83715c-c34d-42a8-a0c2-8fd887c34e50 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:09.095105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0a83715c-c34d-42a8-a0c2-8fd887c34e50 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1213 microversion: 2.1 time: 0.075161 Sep 11 05:31:09.095790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 124/242] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:09 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:09.111269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:09.111918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:09.118534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:09.119350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:09.119797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:09.120552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:09.121292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:09.121736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:09.230000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:09.238640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-600eedda-5dc8-46d0-b3ab-b7d4cdaf9999 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1272 microversion: 2.1 time: 0.132871 Sep 11 05:31:09.239359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 119/243] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:09 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:09.810287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:09.811348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:09.818553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:09.819085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:09.819769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:09.821105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:09.821726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:09.822140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:09.960248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:09.969195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-54d3066e-2cd6-4daf-b159-1e64f382c802 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.163263 Sep 11 05:31:09.969782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 125/244] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:09 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:10.118655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:10.119265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:10.126665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:10.127428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:10.127932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:10.128872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:10.129424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:10.129861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:10.192365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:10.199969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-081087ff-1de4-416d-967e-97ddcc41084c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1217 microversion: 2.1 time: 0.085154 Sep 11 05:31:10.200572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 120/245] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:10 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:10.264513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:10.265071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:10.271393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:10.271876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:10.272349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:10.273040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:10.273497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:10.273922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:10.291940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:10.403243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:10.411593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a742d5b0-011b-4378-85a4-54cae96c20c5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.151687 Sep 11 05:31:10.412177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 126/246] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:10 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:10.994726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:10.995602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:11.003009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.003506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.004042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.004742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.005200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.005623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.139813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:11.147488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6f05842-4143-4f7e-82a0-aa9ffaf797bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.158156 Sep 11 05:31:11.148071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 121/247] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:10 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:11.223088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:11.223705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:11.229671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.230947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.232313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.233541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.234237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.234941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.312019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:11.319974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-294d48e3-8db6-421e-8289-ae527b339d4f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1217 microversion: 2.1 time: 0.100893 Sep 11 05:31:11.320578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 127/248] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:11 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:11.439337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:11.439663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:11.446435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.446954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.447443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.448177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.448633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.449053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.663929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:11.672984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4a6126f-03d1-44b8-9a2c-93ac72dd2f8d tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.238491 Sep 11 05:31:11.673648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 122/249] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:11 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:11.931708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35cbab-5ce4-4e29-82fd-e2d07b19835a", "tag": "236ac66c-3867-451f-99cd-5f207ad1caf6"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:11.942669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:11.943074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:11.943527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:11.958238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] Creating event network-changed:236ac66c-3867-451f-99cd-5f207ad1caf6 for instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a on hv-cinder-85692 Sep 11 05:31:11.963052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b9ecfa4d-7cc1-4fa5-8710-9b3b8adfa5da req-a1e3a0c7-49ac-4467-a08f-e69cca026434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035251 Sep 11 05:31:11.963540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 128/250] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:12.172893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:12.173498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:12.190782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.191282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.191744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.192461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.192980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.193332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.343752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:12.344565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:12.351542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.352061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.352597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.353312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.353766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.354185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.451249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:12.458177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fdb7214b-da62-47ca-a4dd-f40e6108f8f5 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1265 microversion: 2.1 time: 0.119033 Sep 11 05:31:12.459216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 129/251] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:12 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:12.483691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:12.484383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:12.491038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.491630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.492121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.493040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.493631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.494055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.534267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:31:12.603873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:12.611862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64037da5-b9b5-41b1-be6a-c3a0e1815d31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.443581 Sep 11 05:31:12.612473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 123/252] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:12 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:12.616035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:12.627468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e752a291-a1e7-4369-b326-3e3006a7746d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 204 len: 0 microversion: 2.1 time: 0.154083 Sep 11 05:31:12.628071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 130/253] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:31:12 2022] DELETE /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:31:12.636451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:12.637190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:12.643727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.644282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.644721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.645404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.645859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.646279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.696953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:12.697763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:12.705800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.706357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.706910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.707714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:12.708448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:12.709104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:12.777219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:12.786840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bd898a4-0475-48f0-8f31-ba252f2d39c2 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1552 microversion: 2.1 time: 0.154551 Sep 11 05:31:12.787518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 124/254] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:12 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:12.845004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:12.853948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-98be04a8-7c7f-4384-bb8d-e81576723b6e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.161262 Sep 11 05:31:12.854787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 131/255] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:12 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:13.483225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:13.483806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:13.489857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.490343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.490777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.491462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.491919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.492370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.555584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:13.564191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e73978b-8244-4a5d-86a3-d637a0373094 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1273 microversion: 2.1 time: 0.085400 Sep 11 05:31:13.564749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 125/256] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:13 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:13.638271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:13.638879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:13.645186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.645666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.646100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.646780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.647230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.647651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.777606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:13.785617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f95cd081-c450-4f9f-bd3b-f722cb1c03da tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.152176 Sep 11 05:31:13.786173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 132/257] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:13 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:13.809300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:13.810692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:13.816575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.817054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.817484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.818166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.818619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.819034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.834353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:13.877303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:13.877943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:13.884055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.884569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.885003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.885691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:13.886213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:13.886635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:13.950889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:13.960230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55d0b684-0a65-403f-8561-8f62b4675946 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1552 microversion: 2.1 time: 0.154624 Sep 11 05:31:13.960995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 126/258] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:13 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:14.018401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:14.026098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f31f1966-f8ee-41c9-9345-dfe8e18f391b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.152637 Sep 11 05:31:14.026591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 133/259] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:13 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:14.586698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:14.587218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:14.593728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.594200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.594624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:14.595297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.595746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.596187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:14.657508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:14.665003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-285c195e-026e-496e-a7fe-b5995f65b899 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1273 microversion: 2.1 time: 0.082212 Sep 11 05:31:14.665551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 127/260] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:14 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:14.808639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:14.809249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:14.815784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.816290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.816727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:14.817409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.817862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.818283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:14.946371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:14.954556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d8142d3b-56e7-44c2-b1bf-8002102816f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.149793 Sep 11 05:31:14.955113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 134/261] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:14 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:14.985141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:14.985878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:14.993148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.993663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.994095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:14.995137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:14.995929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:14.996498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.048527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:15.049145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:15.054889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.055386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.055825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.056548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.057053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.057475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.200874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:15.208979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40277340-4d58-4a4d-968e-4519198418c3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.164173 Sep 11 05:31:15.209560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 135/262] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:15 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:15.256515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:15.265468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4df63023-4a0e-4786-bcd8-054aa50dedcf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1552 microversion: 2.1 time: 0.285210 Sep 11 05:31:15.266044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 128/263] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:14 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1552 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:15.689434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:15.689972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:15.696044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.696526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.696963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.697646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.698091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.698506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.844013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:15.851420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4bcd590a-1625-4b32-b12a-4bbf4894094d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.166894 Sep 11 05:31:15.851976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 136/264] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:15 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:15.981132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:15.981793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:15.987898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.988424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.988856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:15.989568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:15.990204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:15.990629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.196106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:16.203784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e1a17b8-a461-4b14-b495-040378c89905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.226641 Sep 11 05:31:16.204433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 129/265] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:15 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:16.232917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:16.233524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:16.239496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.240088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.240599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.241359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.241890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.242443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.288944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:16.289543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:16.296101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.296624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.297062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.297761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.298221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.298647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.386246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:16.394060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-011a7b86-0404-4091-8e0d-a49233a405fa tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.165523 Sep 11 05:31:16.394720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 137/266] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:16 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:16.806218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:16.815582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c02239f-4301-4d87-9900-9c6f48f903a7 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1552 microversion: 2.1 time: 0.530574 Sep 11 05:31:16.816187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 130/267] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:16 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1552 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:16.875402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:16.876135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:16.882548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.883144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.883910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:16.884687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:16.885293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:16.885789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.026235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:17.034038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e9e5478-a0c4-4d11-b9fd-3c6995f021b0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.163100 Sep 11 05:31:17.034609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 138/268] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:16 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:17.227437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:17.228081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:17.234932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.235902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.236396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.237128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.237590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.238018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.421641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:17.422254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:17.433021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.433634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.434074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.434991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.435454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.435861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.574607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:17.583156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-980093d0-c08d-4c57-91a8-241ff6223c33 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.168777 Sep 11 05:31:17.583667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 139/269] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:17 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:17.681522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd35efc-966f-4a5c-8049-f9db2416e615", "name": "network-vif-deleted", "tag": "50bb4dca-38a6-47da-8dca-94698f43dd3d"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:17.691286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.691862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.692331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.704528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] Creating event network-vif-deleted:50bb4dca-38a6-47da-8dca-94698f43dd3d for instance 3fd35efc-966f-4a5c-8049-f9db2416e615 on hv-cinder-85692 Sep 11 05:31:17.710223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-c839419f-4d95-4b00-af68-00c352b88070 req-f5aeb99c-ce7c-4b90-ac4f-36d387278140 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Sep 11 05:31:17.711028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 140/270] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:17.745072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:17.753091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6636344e-95a1-40d0-8b05-ef9273754a23 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.530147 Sep 11 05:31:17.753654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 131/271] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:17 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:17.839759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:17.840502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:17.847338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.847818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.848288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.848973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:17.849427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:17.849847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:17.915269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:17.923530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63f3ee71-e192-4db1-aeb3-f6d4b3a845b3 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1510 microversion: 2.1 time: 0.088101 Sep 11 05:31:17.924105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 141/272] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:17 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:18.058157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:18.058774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:18.065926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.066439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.066933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.067622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.068128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.068550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.199214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:18.208191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c281d870-89a9-4666-9d5d-ea74fcd8cbd6 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.153766 Sep 11 05:31:18.208762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 132/273] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:18 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:18.606060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:18.607434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:18.613285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.613764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.614194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.614876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.615325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.615744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.744145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:18.748855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:18.753930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1fe949e0-7506-44b6-987a-8055f8ab6880 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.151688 Sep 11 05:31:18.754523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 142/274] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:18 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:18.776875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:18.777490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:18.783529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.784039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.784475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.785165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.785623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.786051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.912728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:18.920921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5d36481-fec6-4c4d-b27c-63064982f991 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.147905 Sep 11 05:31:18.921482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 133/275] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:18 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:18.948218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:18.948935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:18.960446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.960924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.961353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:18.962039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:18.962489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:18.962906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.027481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:19.036574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5cdab6e1-2a2b-4274-81cc-896b0bbcdf88 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1510 microversion: 2.1 time: 0.092154 Sep 11 05:31:19.037147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 143/276] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:18 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:19.230858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:19.231506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:19.233635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:19.234441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=12 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:19.241929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.242416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.242848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.243531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.243983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.244432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.373811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:19.381360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e623d8c-46cf-4162-820c-3f1ba54c92d0 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.154363 Sep 11 05:31:19.381917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 134/277] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:19 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:19.725369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83eb902c-db49-46f0-aa85-11abb96de518", "tag": "cc898bb7-7daf-4aed-aeda-a72ee689946b"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:19.730186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:19.735916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.736419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.736845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.747235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] Creating event network-changed:cc898bb7-7daf-4aed-aeda-a72ee689946b for instance 83eb902c-db49-46f0-aa85-11abb96de518 on hv-cinder-85692 Sep 11 05:31:19.752481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-5be138ac-9420-42b1-b0f5-628ea699f4b9 req-5f6fe149-adef-4533-a0ba-922b85bea899 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Sep 11 05:31:19.753048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 144/278] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:19.776854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:19.777461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:19.783453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.783938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.784399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.785085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.785542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.785963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.916959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:19.925228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7521fd4c-5b53-4c69-ab38-833438cf9873 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.152191 Sep 11 05:31:19.925789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 135/279] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:19 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:19.943683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:19.944408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:19.951170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.952051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.952496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:19.953302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:19.953855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:19.954370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.062227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:20.063075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:20.066582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:20.070757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.071248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.071689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.072420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.072882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.073309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.086757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:20.094984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e9832ea-6d54-479e-869c-4fd9af8cbd68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.155705 Sep 11 05:31:20.095563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 145/280] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:19 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:20.137782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:20.147244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa4a3108-dd4e-45f2-884d-e6c78cd21488 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1510 microversion: 2.1 time: 0.090433 Sep 11 05:31:20.147806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 136/281] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:20 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1510 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:20.405905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:20.406494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:20.412373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.412851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.413284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.413967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.414423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.414842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.541359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:20.549995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c012aa25-510b-4980-897b-51e090dece95 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.148624 Sep 11 05:31:20.550556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 146/282] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:20 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:20.947634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:20.948173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:20.954717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.955202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.955637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:20.956348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:20.956806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:20.957223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.083467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:21.091104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3eca78f1-8db6-4b21-a537-41796909b11f tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.147368 Sep 11 05:31:21.091665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 137/283] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:20 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:21.120551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:21.121162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:21.128401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.128878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.129301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.129990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.130444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.130856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.168673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:21.169285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:21.175349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.175832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.176295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.176985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.177437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.177857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.241443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:21.254349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b28ba2a2-3b79-4e84-9846-da6b9e22b9bf tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1510 microversion: 2.1 time: 0.089124 Sep 11 05:31:21.255049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 138/284] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:21 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1510 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:21.263349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:21.271738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8112e344-4559-4fee-a5db-998d61f1453f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.156471 Sep 11 05:31:21.272693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 147/285] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:21 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:21.572232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:21.572846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:21.579096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.579581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.580095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.580824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:21.581328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:21.581748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:21.795593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:21.804300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-676893f8-f596-46be-b252-39640e61e546 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.236081 Sep 11 05:31:21.805125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 139/286] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:21 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:22.114389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:22.114758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:22.120675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.121192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.121591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.122291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.122752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.124151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.257377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:22.266377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f12c2f6f-1ef1-49a9-99bd-72a690dfc99c tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.156156 Sep 11 05:31:22.267277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 148/287] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:22 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:22.281595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:22.282251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:22.288751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.289240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.289677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.290383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.290842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.291270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.298528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:22.299138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:22.305669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.306201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.306632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.307514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.307973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.308594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.333588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.334324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.334915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.335592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lazy-loading 'fault' on Instance uuid 3fd35efc-966f-4a5c-8049-f9db2416e615 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:22.388966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:22.398189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0a0e9ea-608b-4d63-aea2-ebd5b5f87eeb tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1350 microversion: 2.1 time: 0.121949 Sep 11 05:31:22.398772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 140/288] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:22 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:22.459117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:22.466852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb8cd700-8697-462e-a9ae-3d28fda30cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.174442 Sep 11 05:31:22.467491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 149/289] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:22 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:22.827007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:22.828247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:22.834426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.834921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.835338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.836047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:22.836502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:22.836923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:22.970413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:22.978368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d8c883f-cf3f-4bcc-bb75-1306decdf6b4 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.155246 Sep 11 05:31:22.978955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 141/290] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:22 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:23.292528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:23.293034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:23.300301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.300780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.301210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.301889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.302390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.302794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.423572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:23.424216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:23.430028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.430510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.430938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.431621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.432105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.432517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.435003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:23.442731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3963d156-c760-4267-a096-3831df0567c4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.154320 Sep 11 05:31:23.443395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 150/291] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:23 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:23.462520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.462991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.463418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.463852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lazy-loading 'fault' on Instance uuid 3fd35efc-966f-4a5c-8049-f9db2416e615 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:23.466452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:23.491030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:23.491722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:23.498106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.498770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.499206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.500149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:23.500601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:23.501019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:23.509072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:23.524304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a34391c-a38f-4c6b-9789-1f4a4c7c11a5 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1350 microversion: 2.1 time: 0.099800 Sep 11 05:31:23.524304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 142/292] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:23 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:23.632539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:23.640923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f8a287a-9d40-490a-8a6b-5bb61a2bb735 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.153079 Sep 11 05:31:23.641477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 151/293] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:23 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:24.002893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:24.003427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:24.009606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.010082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.010503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.011190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.011640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.012081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.141631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:24.149379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45888075-6ca7-49c0-ad2e-56dab2443013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.151218 Sep 11 05:31:24.149953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 143/294] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:23 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:24.465542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:24.466185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:24.472638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.473117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.473549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.474265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.474717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.475138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.541234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:24.541873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:24.548597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.548930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.549365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.550060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.550515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.550939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.588455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.588939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.589368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.589812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lazy-loading 'fault' on Instance uuid 3fd35efc-966f-4a5c-8049-f9db2416e615 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:24.610866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:24.618928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a7da495-f164-499d-b2c8-79d7d19f4bb3 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.157169 Sep 11 05:31:24.619499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 152/295] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:24 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:24.634682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:24.642932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2a9291b-d485-4cb7-a469-6110ff4ef4be tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1350 microversion: 2.1 time: 0.105500 Sep 11 05:31:24.643519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 144/296] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:24 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:24.663977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:24.664612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:24.670388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.670868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.671303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.671988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:24.673040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:24.673490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:24.802511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:24.810212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9467311-955f-439d-a393-9a4528591258 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.149965 Sep 11 05:31:24.810771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 153/297] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:24 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:25.172608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:25.173256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:25.179128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.179613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.180072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.180766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.181225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.181650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.444502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:25.452024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9db5b69-1991-4149-91fc-40faee76af3b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.283429 Sep 11 05:31:25.452574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 145/298] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:25 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:25.643247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:25.643863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:25.650290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.650773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.651212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.651907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.652401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.652827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.664932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:25.665540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:25.671719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.672225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.672652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.673521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.674188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.674610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.708987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.709682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.709796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.710216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lazy-loading 'fault' on Instance uuid 3fd35efc-966f-4a5c-8049-f9db2416e615 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:25.753864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:25.763923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3a3d4e0-2b73-4038-9c59-867a8085ef94 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1350 microversion: 2.1 time: 0.102569 Sep 11 05:31:25.768142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 146/299] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:25 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:25.831369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:25.834454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:25.835064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:25.845347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-634ccbff-9495-4e7d-b984-94521945530b tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.206183 Sep 11 05:31:25.861100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 154/300] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:25 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:25.861100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35cbab-5ce4-4e29-82fd-e2d07b19835a", "name": "network-vif-plugged", "status": "completed", "tag": "236ac66c-3867-451f-99cd-5f207ad1caf6"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:25.861419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.861419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.861419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.861419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.861772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.861772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.861954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:25.861954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:25.862338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:25.875343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] Creating event network-vif-plugged:236ac66c-3867-451f-99cd-5f207ad1caf6 for instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a on hv-cinder-85692 Sep 11 05:31:25.880833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-55e5e2e7-fca7-4590-8fb9-7bed8eb82f54 req-ac63c94e-684c-4a74-b44c-410033d68083 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Sep 11 05:31:25.881890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 155/301] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:26.000856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:26.009000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-085fc54f-ea98-4ad0-8a53-e71293b6804d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.178385 Sep 11 05:31:26.009547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 147/302] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:25 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:26.475944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:26.476689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:26.482710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.483189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.483621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.484335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.484784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.485204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.619279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:26.628114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e4ce4b1-14a2-4b4a-987c-f074fd5ceb44 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.156453 Sep 11 05:31:26.628684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 156/303] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:26 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:26.788460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:26.789679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:26.795607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.796435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.797099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.798673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.799257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.799715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.833832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.834334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.834793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.835238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lazy-loading 'fault' on Instance uuid 3fd35efc-966f-4a5c-8049-f9db2416e615 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:26.868642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:26.869375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:26.876866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.877633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.878265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.880949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:26.881676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:26.885700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c988c57fa47e9b58af2914ff6306d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431b72dd50e44a53a597b28404ace63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:26.888273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:26.894170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-722726a9-5338-48d2-b327-f30470861a8a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 200 len: 1304 microversion: 2.1 time: 0.109224 Sep 11 05:31:26.908255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 148/304] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:26 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:27.032820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:27.033515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:27.039845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.040386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.041025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.042133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.042752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.043526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.057067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:27.066151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d1c87ad5-b360-4234-8099-ca3ed1792787 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.201698 Sep 11 05:31:27.068169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 157/305] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:26 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:27.178773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:27.186475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-343e053b-736f-4f34-8b8f-331f2dd3819c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.158057 Sep 11 05:31:27.187025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 149/306] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:27 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:27.653906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:27.654507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:27.661296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.661770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.662202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.662879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.663325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.663743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.799397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:27.807193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf23b927-3062-4db5-9f44-c9f40184c84b tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.157030 Sep 11 05:31:27.808500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 158/307] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:27 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:27.917875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:27.918546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:27.925977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.926558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.926999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.927704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:27.928202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:27.928639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:27.942864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] HTTP exception thrown: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Request method failure captured: Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 HTTP/1.1 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJXi2iaXQosqwZVlIm25EGlj92cgO9mzJPu1i2REYRJXJm30nv0tpZ70YkJVE9MWjouRASeidwKHJO3RMFq6j3XKaLiKg_k0LDnMiixv3RvrqnD8m6iZxJDntYOEOctQU9qNkgyox3Z3UjUeh24ivKxwTieEvFdxjy66KTmb662FB4 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:27.947793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_431b72dd50e44a53a597b28404ace63c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}] Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 065c988c57fa47e9b58af2914ff6306d Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:27.949368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '3fd35efc-966f-4a5c-8049-f9db2416e615'} Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:27.950269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:27.951720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:27.953086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Returning 404 to user: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:27.953086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-698d3781-f63b-458b-85af-35dacde9de5a tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 404 len: 111 microversion: 2.1 time: 0.035455 Sep 11 05:31:27.953086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 150/308] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:27 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:28.065448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:28.067611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:28.073914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.074391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.074828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.075509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.075968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.076417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.090223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:28.090881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:28.097458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.097954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.098400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.099115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.099580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.100016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.228421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] HTTP exception thrown: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Request method failure captured: Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615/os-volume_attachments HTTP/1.1 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJXi2iaXQosqwZVlIm25EGlj92cgO9mzJPu1i2REYRJXJm30nv0tpZ70YkJVE9MWjouRASeidwKHJO3RMFq6j3XKaLiKg_k0LDnMiixv3RvrqnD8m6iZxJDntYOEOctQU9qNkgyox3Z3UjUeh24ivKxwTieEvFdxjy66KTmb662FB4 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:31:28.233191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_431b72dd50e44a53a597b28404ace63c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}] Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 065c988c57fa47e9b58af2914ff6306d Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:28.234597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '3fd35efc-966f-4a5c-8049-f9db2416e615'} Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:28.235934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:28.237227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:28.238402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Returning 404 to user: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:28.238402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3dd3805c-6d46-4936-94e3-026d6dacc678 tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.173919 Sep 11 05:31:28.238402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 159/309] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:31:28 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615/os-volume_attachments => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:28.240847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:28.241464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:28.248180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:28.248649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.249209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.249710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.252919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.253076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.253511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.257268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec197230-a014-4622-83e2-e9f201c7a098 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.171055 Sep 11 05:31:28.258007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 151/310] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:28 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:28.388682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:28.396866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-90131876-8df3-4a82-b1d0-9a07a78594ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.160151 Sep 11 05:31:28.397419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 160/311] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:28 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:28.836494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:28.837103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:28.842946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.843421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.843847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.844553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:28.845810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:28.846427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:28.975976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:28.983640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89d41b5e-d1fe-4e6b-affa-095c6c2b59b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.150995 Sep 11 05:31:28.984222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 152/312] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:28 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:29.280826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:29.281427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:29.288095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:29.288575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:29.289032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:29.289833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:29.290335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:29.290776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:29.309038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:29.419763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:29.420436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:29.425934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:29.427296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:29.427887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:29.428456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:29.429309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:29.429844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:29.430333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:29.433885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a89e90e7-9191-49ad-8c66-e1eb0b9514e6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.156908 Sep 11 05:31:29.434911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 161/313] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:29 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:29.559694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:29.568047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da3bbd7a-1190-4b68-846c-db37f4239053 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.152207 Sep 11 05:31:29.568605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 153/314] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:29 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:30.006530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:30.007163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:30.013693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.014175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.014608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.015293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.015745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.016212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.143677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:30.151253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46af8c84-88ef-450c-a85b-1ac7ea823645 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.149257 Sep 11 05:31:30.151809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 162/315] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:30 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:30.457631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:30.458242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:30.464178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.464660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.465095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.465777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.466231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.466664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.590768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:30.591386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:30.596616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:30.597477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.597964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.598457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.599198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:30.599895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:30.600363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:30.605392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7a21c71-b88a-46e8-afa1-529e75fa791e tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.151947 Sep 11 05:31:30.605962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 154/316] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:30 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:30.728079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:30.735584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-774e9d99-1dfe-4d44-863c-033a644acbf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.148766 Sep 11 05:31:30.736173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 163/317] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:30 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:31.174820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:31.175430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:31.181385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.181876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.182312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.183001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.183459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.183886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.313544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:31.321402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a34d9af8-ec13-47ce-b2c0-ca4f4c269c8a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.150467 Sep 11 05:31:31.321955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 155/318] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:31 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:31.629334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:31.629931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:31.636513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.636995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.637423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.638106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.638555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.638973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.759519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:31.760136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:31.765922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.766458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.766860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.767545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:31.768890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:31.769679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:31.781867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:31.789983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64a5da0a-5fba-4869-b58c-e33aa4cd17b6 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.165038 Sep 11 05:31:31.790484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 164/319] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:31 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:31.908165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:31.916199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb66c617-7837-40eb-b2fd-385f50456df2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.160833 Sep 11 05:31:31.916778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 156/320] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:31 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:32.344490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:32.345137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:32.351883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.352404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.352846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.353540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.353997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.354421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.486429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:32.494684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d559dd50-8d8d-4b0e-bb2f-b763c5df9ade tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.153980 Sep 11 05:31:32.495241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 165/321] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:32 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:32.816372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:32.816989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:32.823085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.823566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.824015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.824728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.825178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.825595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.941407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:32.942162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:32.948608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.949165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.949676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.950460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:32.950973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:32.951398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:32.957962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:32.965648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3702f5b3-e38c-4e00-a257-8bf0dbee76b1 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1314 microversion: 2.1 time: 0.153631 Sep 11 05:31:32.966206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 157/322] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:32 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:33.081754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:33.089355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b36a792-6b22-4b8c-a82a-f73ef6a5aced tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.152429 Sep 11 05:31:33.089918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 166/323] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:32 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:33.517997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:33.518601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:33.524537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:33.525017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:33.525492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:33.526122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:33.526569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:33.526985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:33.658122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:33.660981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:33.667728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-092c3d3a-1291-450b-95ed-f61cd3f69744 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.153595 Sep 11 05:31:33.668451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 158/324] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:33 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:33.988562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:33.989167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:33.995476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:33.995952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:33.996412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:33.997095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:33.997544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:33.997961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.112585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:34.113223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:34.119301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.119785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.120324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.121018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.121499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.121923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.125375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:34.133734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d030ac7-5a27-49d3-add3-561dba9baca5 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1464 microversion: 2.1 time: 0.149514 Sep 11 05:31:34.134616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 167/325] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:33 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:34.182556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:34.183116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:34.189291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.189840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.190363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.190971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.191442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.191872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.219819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:31:34.255171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:34.263240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2fe8b39-c870-4e34-a7c5-17daaf920175 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.154931 Sep 11 05:31:34.263808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 159/326] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:34 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:34.295259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfc545d6-b6d4-4fd0-a417-2ee94d2f9153 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 204 len: 0 microversion: 2.1 time: 0.116412 Sep 11 05:31:34.295846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 168/327] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:31:34 2022] DELETE /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 05:31:34.304692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:34.305310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:34.311232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.311755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.312241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.312957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.313462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.313949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.449105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:34.457140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7bf1261-7652-494c-85e2-9ea890317884 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1470 microversion: 2.1 time: 0.156408 Sep 11 05:31:34.457698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 160/328] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:34 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:34.691939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:34.692570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:34.698674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.699160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.699599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.700366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:34.700840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:34.701182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:34.832178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:34.839950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa08cc77-cc41-4ef4-99a4-6c790055ca3e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.152542 Sep 11 05:31:34.840527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 169/329] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:34 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:35.246253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb902c-db49-46f0-aa85-11abb96de518", "name": "network-vif-plugged", "status": "completed", "tag": "cc898bb7-7daf-4aed-aeda-a72ee689946b"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:35.256182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.256758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.257101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.269128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] Creating event network-vif-plugged:cc898bb7-7daf-4aed-aeda-a72ee689946b for instance 83eb902c-db49-46f0-aa85-11abb96de518 on hv-cinder-85692 Sep 11 05:31:35.274011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-d99a6e4a-3950-4859-b136-7f986d8a3033 req-2fcec96d-aaa9-461c-9543-6411b116946d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031421 Sep 11 05:31:35.274592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 161/330] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:35.289496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:35.290212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:35.296351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.296919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.297417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.298168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.298629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.299645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.433466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:35.441634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b54e66f-126b-4732-87ca-33bb78b8ab24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.158247 Sep 11 05:31:35.442196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 170/331] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:35 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:35.480703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:35.481427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:35.487551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.488059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.488495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.489219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.489645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.490067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.619484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:35.628527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78f8e3e3-90b5-4b17-b1f9-655a1fcb81ff tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1470 microversion: 2.1 time: 0.152131 Sep 11 05:31:35.629094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 162/332] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:35 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:35.862777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:35.863396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:35.869743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.870230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.870671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:35.871372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:35.871835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:35.872291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.007747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:36.015705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-136aaa60-548e-4d7a-87ea-c55f44488770 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.156820 Sep 11 05:31:36.016344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 171/333] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:35 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:36.465122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:36.465729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:36.472963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.473439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.473868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.474547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.474997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.475415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.613617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:36.621202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98c23887-4e93-4ff2-baa9-749081352201 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.160176 Sep 11 05:31:36.621747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 163/334] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:36 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:36.651564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:36.652197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:36.659371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.659849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.660309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.660999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.661452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.661873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.794196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:36.802062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09893811-702c-4410-88a8-0f480bd29128 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1470 microversion: 2.1 time: 0.154303 Sep 11 05:31:36.802617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 172/335] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:36 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:36.833295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:36.833791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:36.840069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.840637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.841148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.841998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.842451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.842871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.856804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] HTTP exception thrown: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Request method failure captured: Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 HTTP/1.1 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJXi2iaXQosqwZVlIm25EGlj92cgO9mzJPu1i2REYRJXJm30nv0tpZ70YkJVE9MWjouRASeidwKHJO3RMFq6j3XKaLiKg_k0LDnMiixv3RvrqnD8m6iZxJDntYOEOctQU9qNkgyox3Z3UjUeh24ivKxwTieEvFdxjy66KTmb662FB4 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:36.858426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_431b72dd50e44a53a597b28404ace63c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}] Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 065c988c57fa47e9b58af2914ff6306d Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.859810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '3fd35efc-966f-4a5c-8049-f9db2416e615'} Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:36.860613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.861913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.863189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Returning 404 to user: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:36.863189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bf94cde-131f-4a6c-8744-bcfa0efb344b tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 404 len: 111 microversion: 2.1 time: 0.031468 Sep 11 05:31:36.863189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 164/336] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:31:36 2022] DELETE /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:36.868565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:36.869178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] [instance: 3fd35efc-966f-4a5c-8049-f9db2416e615] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:36.875109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.875591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.876064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.877452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:36.878097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:36.878528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:36.891719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] HTTP exception thrown: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Request method failure captured: Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 HTTP/1.1 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJXi2iaXQosqwZVlIm25EGlj92cgO9mzJPu1i2REYRJXJm30nv0tpZ70YkJVE9MWjouRASeidwKHJO3RMFq6j3XKaLiKg_k0LDnMiixv3RvrqnD8m6iZxJDntYOEOctQU9qNkgyox3Z3UjUeh24ivKxwTieEvFdxjy66KTmb662FB4 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:31:36.894139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_431b72dd50e44a53a597b28404ace63c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/431b72dd50e44a53a597b28404ace63c"}]}] Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 431b72dd50e44a53a597b28404ace63c Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168718264 Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 065c988c57fa47e9b58af2914ff6306d Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-DeleteServersTestJSON-1168718264-project Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.895532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '3fd35efc-966f-4a5c-8049-f9db2416e615'} Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:36.896384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. Sep 11 05:31:36.897690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:36.898841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] Returning 404 to user: Instance 3fd35efc-966f-4a5c-8049-f9db2416e615 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:36.898841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0470ccb9-b5c5-4e65-b88c-37901a04383d tempest-DeleteServersTestJSON-1168718264 tempest-DeleteServersTestJSON-1168718264-project] 10.222.0.33 "GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615" status: 404 len: 111 microversion: 2.1 time: 0.030753 Sep 11 05:31:36.898841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 173/337] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:36 2022] GET /compute/v2.1/servers/3fd35efc-966f-4a5c-8049-f9db2416e615 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:37.039408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:37.040174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:37.046118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.046541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.046976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:37.047685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.048190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.048612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:37.285090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:37.292782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5e9a474-043a-4b86-ac3a-e6f068fcbe25 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.257368 Sep 11 05:31:37.293337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 165/338] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:37 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:37.645105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:37.645902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:37.651916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.652521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.652849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:37.653594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.654045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.654460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:37.785376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:37.798354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45cb4ff3-6c75-42e0-804d-7792f9711055 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.158006 Sep 11 05:31:37.799134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 174/339] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:37 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:37.825166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:37.825827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:37.833404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.833918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.834350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:37.835040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:37.835491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:37.835909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:38.073964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:38.082827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd43f240-e631-47d3-a7bf-c7ac045a42f8 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1470 microversion: 2.1 time: 0.261408 Sep 11 05:31:38.083392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 166/340] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:37 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:38.316559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:38.317177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:38.323200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:38.323688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:38.324163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:38.324868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:38.325326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:38.325751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:38.461198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:38.469004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ccaff00-3e6d-446b-9eab-4e2ce067d685 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.156332 Sep 11 05:31:38.469818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 175/341] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:38 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:38.821923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:38.822681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:38.829174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:38.829772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:38.830694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:38.831459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:38.831969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:38.832428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.093843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:39.106643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:39.109536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:39.118792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:39.124471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e06e97f8-c00d-4cef-a2d8-52dde1ccabb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.306462 Sep 11 05:31:39.126130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 167/342] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:38 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:39.126968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:39.127693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:39.128636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.130490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:39.131135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:39.131715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.362787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:39.371988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-89c23160-5c43-4e0f-be23-c285b0796c91 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1470 microversion: 2.1 time: 0.269798 Sep 11 05:31:39.372706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 176/343] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:39 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:39.405809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35cbab-5ce4-4e29-82fd-e2d07b19835a", "name": "network-vif-deleted", "tag": "236ac66c-3867-451f-99cd-5f207ad1caf6"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:39.416594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:39.417155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:39.417624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.431922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] Creating event network-vif-deleted:236ac66c-3867-451f-99cd-5f207ad1caf6 for instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a on hv-cinder-85692 Sep 11 05:31:39.442132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c6f0f57d-6ed8-4e0d-a7c2-b54c38779f02 req-8b7712f1-06ef-40f4-bde0-fcbc61224d30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039879 Sep 11 05:31:39.442947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 168/344] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:31:39.494103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:39.495588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:39.502924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:39.503649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:39.504298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.505036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:39.505573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:39.506032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:39.510753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:39.778367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:39.800032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0399501f-15a8-40c2-a36f-e7973335f826 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1313 microversion: 2.1 time: 0.310085 Sep 11 05:31:39.804641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 177/345] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:39 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:40.149190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:40.150609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:40.160112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.160862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.161570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.162657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.163488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.164177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.396406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:40.397592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:40.404035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.404625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.404942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.405647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.406099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.406522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.425189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:40.438008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e28a6cc-6b34-4636-b1b1-9d2ff29812ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.293530 Sep 11 05:31:40.454634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 169/346] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:40 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:40.483574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.484094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.484536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.484997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:40.541571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:40.549482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8993b63-a13c-40d5-bd74-5eafa767d9c9 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.157458 Sep 11 05:31:40.550135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 178/347] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:40 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:40.823943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:40.824591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:40.831309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.831786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.832246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:40.832924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:40.833375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:40.833792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.063512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:41.078201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1adcdd5-4883-4201-9173-4acfa8f84013 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1497 microversion: 2.1 time: 0.257824 Sep 11 05:31:41.079272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 170/348] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:40 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:41.463238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:41.463843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:41.475210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.476144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.476740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.480737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.481217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.481657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.575288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:41.576073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:41.592832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.593894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.594773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.596258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.597191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.597972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.649134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.649938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.650554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.651186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:41.653749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:41.666247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4866875e-f3c4-482d-8961-c182093ed6aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.207225 Sep 11 05:31:41.667014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 179/349] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:41 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:41.729688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:41.730545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:41.741592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.743660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.746245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.747017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.748506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.750530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.781081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:41.801830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:31:41.806067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1c12814-b359-46f7-9d44-354835981b5a tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.236279 Sep 11 05:31:41.807400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 171/350] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:41 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:41.888183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61aa486d-8f47-44cd-b1c6-a8a32a91fa75 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 204 len: 0 microversion: 2.1 time: 0.162685 Sep 11 05:31:41.888869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 180/351] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:31:41 2022] DELETE /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 05:31:41.897673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:41.898572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:41.904754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.905239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.905673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:41.906550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:41.906986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:41.907412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.041985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:42.049719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1a306c4-9d4b-4507-9f74-88bf3f03eabf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.155821 Sep 11 05:31:42.050307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 172/352] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:41 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:42.589864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-844b62c9-7e9b-4a8e-a5d7-8ce752a53235 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Action: 'create', calling method: .version_select at 0x7f2c3f3e8ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1046532017", "metadata": {"Type": "work"}}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-844b62c9-7e9b-4a8e-a5d7-8ce752a53235 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 122 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:31:42.598884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1046532017", "metadata": {"Type": "work"}}} Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: Sep 11 05:31:42.600389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1046532017', 'metadata': {'Type': 'work'}}}} Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise error Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.601292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 05:31:42.602570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 05:31:42.603625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 05:31:42.603625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.603625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-844b62c9-7e9b-4a8e-a5d7-8ce752a53235 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.603625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-844b62c9-7e9b-4a8e-a5d7-8ce752a53235 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127233 Sep 11 05:31:42.603625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 181/353] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 11 05:31:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 11 05:31:42.609826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34d8657b-03cd-4afc-afdb-9ef5bbacf12c tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Action: 'create', calling method: .version_select at 0x7f2c3f54da60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-704803791", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34d8657b-03cd-4afc-afdb-9ef5bbacf12c tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 119 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:42.615492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-704803791", "metadata": {"Type": "work"}}} Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 05:31:42.616995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-704803791', 'metadata': {'Type': 'work'}}}} Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise error Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi '0' Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.617885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 05:31:42.619672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 05:31:42.620759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 05:31:42.620759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.620759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34d8657b-03cd-4afc-afdb-9ef5bbacf12c tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.620759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34d8657b-03cd-4afc-afdb-9ef5bbacf12c tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010904 Sep 11 05:31:42.621306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 173/354] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 11 05:31:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:31:42.626202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f12096c-f692-4164-a3a7-cf6860f2df4f tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Action: 'create', calling method: .version_select at 0x7f2c3f315af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-843290679", "metadata": {"Type": "work"}}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f12096c-f692-4164-a3a7-cf6860f2df4f tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 118 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:31:42.631896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-843290679", "metadata": {"Type": "work"}}} Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: Sep 11 05:31:42.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-843290679', 'metadata': {'Type': 'work'}}}} Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise error Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi '' Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.634466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 05:31:42.635979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 05:31:42.637193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 05:31:42.637193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.637193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f12096c-f692-4164-a3a7-cf6860f2df4f tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.637193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5f12096c-f692-4164-a3a7-cf6860f2df4f tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011017 Sep 11 05:31:42.637193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 182/355] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 11 05:31:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:31:42.645021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8efb841-6c60-40e7-8665-8c55673cabc6 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Calling method '.version_select at 0x7f2c3f35fe50>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:42.690507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:42.691231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:42.696824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-a8efb841-6c60-40e7-8665-8c55673cabc6 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] HTTP exception thrown: Volume tempest-invalid-1994188891 could not be found. Sep 11 05:31:42.697541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:42.698061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:42.698495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.699197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:42.699654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:42.700108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8efb841-6c60-40e7-8665-8c55673cabc6 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1994188891 HTTP/1.1 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:42.700481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Volume tempest-invalid-1994188891 could not be found. Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'tempest-invalid-1994188891'} Sep 11 05:31:42.701856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1994188891 could not be found. (HTTP 404) (Request-ID: req-d4193867-bfb2-40b6-8edd-d7d52ec109bc) Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.702598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 05:31:42.703631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1994188891 could not be found. Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:42.705295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1994188891 could not be found. Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1994188891 could not be found. Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8efb841-6c60-40e7-8665-8c55673cabc6 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 404 to user: Volume tempest-invalid-1994188891 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8efb841-6c60-40e7-8665-8c55673cabc6 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1994188891" status: 404 len: 99 microversion: 2.1 time: 0.061788 Sep 11 05:31:42.706493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 174/356] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 11 05:31:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1994188891 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 11 05:31:42.711464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-963339a4-a38d-4e86-a928-2798300bf250 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003727 Sep 11 05:31:42.711960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 175/357] 10.222.0.33 () {58 vars in 1140 bytes} [Sun Sep 11 05:31:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 11 05:31:42.720196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8699c7f2-0d3f-4ae7-ac8c-dd50660e2788 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003673 Sep 11 05:31:42.721240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 176/358] 10.222.0.33 () {58 vars in 1137 bytes} [Sun Sep 11 05:31:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 11 05:31:42.729582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-939db328-ff00-482a-8bc5-996667caa17e tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Calling method '.version_select at 0x7f2c3f2f4c10>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:42.757901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-939db328-ff00-482a-8bc5-996667caa17e tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] HTTP exception thrown: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-939db328-ff00-482a-8bc5-996667caa17e tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/b27836ef-7026-4522-beaa-084f83d31971 HTTP/1.1 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:42.760106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'b27836ef-7026-4522-beaa-084f83d31971'} Sep 11 05:31:42.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. (HTTP 404) (Request-ID: req-58ad324d-bbe1-48be-86d5-6c3732614e12) Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.762373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 05:31:42.763508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 05:31:42.765028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-939db328-ff00-482a-8bc5-996667caa17e tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 404 to user: Volume b27836ef-7026-4522-beaa-084f83d31971 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-939db328-ff00-482a-8bc5-996667caa17e tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/b27836ef-7026-4522-beaa-084f83d31971" status: 404 len: 109 microversion: 2.1 time: 0.035455 Sep 11 05:31:42.766381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 177/359] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 05:31:42 2022] DELETE /compute/v2.1/os-volumes/b27836ef-7026-4522-beaa-084f83d31971 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 05:31:42.771320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db227c7b-6aab-4110-b09c-2cf850f7c0f7 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Calling method '.version_select at 0x7f2c3f2f4dc0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:42.802425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-db227c7b-6aab-4110-b09c-2cf850f7c0f7 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] HTTP exception thrown: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db227c7b-6aab-4110-b09c-2cf850f7c0f7 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Request method failure captured: Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/d1280249-dc27-4b09-8ff3-2651eda9d171 HTTP/1.1 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXK-4AaGr24cqQUbPXQLhNS8Td5sb1WeBMH6OjcH5QVIqMzCNJW4cvdKFKlzEiJYmyFqp6u72_NOAruuEygI648LKsZ5dG56fDgkhNrrDuz_ZYjbxxeJVvRTMatTsgdnUyZsU5Z0udMmmTUWl8s6g073bt8c94rphkjr1QwsWOMVxbI Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:42.804458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0d73e5ef724423dac1a4b235a4d8b94", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0d73e5ef724423dac1a4b235a4d8b94"}]}] Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d0d73e5ef724423dac1a4b235a4d8b94 Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-25915763 Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: e12236a4b4214c8593e619a97b62a129 Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-25915763-project Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'd1280249-dc27-4b09-8ff3-2651eda9d171'} Sep 11 05:31:42.805630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. (HTTP 404) (Request-ID: req-65ce7858-512c-4d32-92c1-3ff1654285b2) Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.806338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 05:31:42.808099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 05:31:42.810148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db227c7b-6aab-4110-b09c-2cf850f7c0f7 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] Returning 404 to user: Volume d1280249-dc27-4b09-8ff3-2651eda9d171 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db227c7b-6aab-4110-b09c-2cf850f7c0f7 tempest-VolumesNegativeTest-25915763 tempest-VolumesNegativeTest-25915763-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1280249-dc27-4b09-8ff3-2651eda9d171" status: 404 len: 109 microversion: 2.1 time: 0.040143 Sep 11 05:31:42.811302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 178/360] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 05:31:42 2022] GET /compute/v2.1/os-volumes/d1280249-dc27-4b09-8ff3-2651eda9d171 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 05:31:42.844182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:42.852659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:42.853545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:42.853817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69b0c7ce-d8d3-4f28-aaaa-b9e02c1dd5e4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.167035 Sep 11 05:31:42.855029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 183/361] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:42 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:42.864624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:42.865800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:42.866432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.867348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:42.868097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:42.868546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.906393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:42.906875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:42.907307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:42.907851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:42.952967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:42.961580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0a624bd-6a39-4bcc-af8f-60cc572c0ddd tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.131675 Sep 11 05:31:42.962230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 179/362] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:42 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:43.074258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:43.074887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:43.081164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.081649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.082079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:43.082765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.083212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.083626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:43.216103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:43.224970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78bf022a-7664-4247-ad6c-bfb7dd57c040 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.154466 Sep 11 05:31:43.225537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 184/363] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:43 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:43.882192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:43.882909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:43.889778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.890507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.891375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:43.892821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.893788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.894500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:43.984411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:43.985587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:43.993174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.994198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.996368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:43.997263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:43.997884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:43.998462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:44.035603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:44.036124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:44.036313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:44.036567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:44.037016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:44.044520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d52d41c2-1f36-4935-8cf9-d4b153a4fae8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.166703 Sep 11 05:31:44.060351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 180/364] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:43 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:44.081040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:44.088836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07265435-ca61-4685-a354-1e6f310a0410 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.108577 Sep 11 05:31:44.089567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 185/365] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:43 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:44.248357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:44.248980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:44.254940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:44.255426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:44.255884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:44.256626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:44.257087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:44.257688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:44.389947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:44.398447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de4f38a9-7c66-4911-ac7b-619c225a080e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.154003 Sep 11 05:31:44.399043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 181/366] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:44 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:45.069063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:45.069674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:45.075871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.076385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.076868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.077519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.077973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.078464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.120890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:45.121565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:45.129245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.129839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.132544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.133368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.134105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.134532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.172353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.172957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.173389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.173850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:45.177096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:45.218802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:45.227808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da28fdfe-c4f5-44e9-9780-1bcfbfe8b017 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.119407 Sep 11 05:31:45.229047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 182/367] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:45 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:45.251000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:45.259669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d4149ff-880d-4781-b719-651fe46a0217 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.194418 Sep 11 05:31:45.260253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 186/368] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:45 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:45.423158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:45.424478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:45.430378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.430864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.431300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.431991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:45.432477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:45.432904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:45.561114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:45.568838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e3d9c19-5f96-4e91-94f5-59627f9844a8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.149623 Sep 11 05:31:45.569397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 183/369] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:45 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:46.250819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:46.251913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:46.258735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.259210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.259640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.260349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.260803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.261219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.284219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:46.284846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:46.287858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:46.291470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.292049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.292486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.293321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.293807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.294223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.294436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.294916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.295348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.295789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:46.335520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:46.343204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3f43ab2-066f-43c2-a562-38e3503f6cec tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.096330 Sep 11 05:31:46.343890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 187/370] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:46 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:46.421961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:46.430203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8eaea93e-c487-4eae-8da8-283a31203d9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.150721 Sep 11 05:31:46.430688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 184/371] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:46 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:46.593205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:46.593808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:46.600639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.601118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.601543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.602222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:46.602672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:46.603091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:46.729832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:46.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc74ff1d-b091-484f-b526-2712283a379c tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.149244 Sep 11 05:31:46.738447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 188/372] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:46 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:47.366765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:47.367371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:47.373221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.373696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.374122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.374823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.375333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.375751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.406082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.406594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.407086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.407577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:47.450978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:47.453593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:47.454238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:47.459018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73a03487-c767-4d74-aa07-20f602e976ae tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.096024 Sep 11 05:31:47.459748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 185/373] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:47 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:47.460827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.461318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.461763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.462467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.462924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.463352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.593688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:47.602172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9b62abd-5261-4db3-bdc3-6ae6e82b201b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1523 microversion: 2.1 time: 0.152421 Sep 11 05:31:47.602730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 189/374] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:47 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:47.762243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:47.763025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:47.769475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.769997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.770513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.771275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:47.771726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:47.772182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:47.903051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:47.911256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bde870d-81db-44a8-8ca5-831666df79cf tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.153160 Sep 11 05:31:47.911822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 186/375] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:47 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:48.484590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:48.485207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:48.491727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.492276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.492717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.493418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.494514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.495041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.527197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.527685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.528156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.528603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lazy-loading 'fault' on Instance uuid ec35cbab-5ce4-4e29-82fd-e2d07b19835a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:48.573813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67b9e5012f34ab4a17ab579131a986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ef16092824511b11494d4388e3c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:48.582242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cad7892e-5792-4627-a773-9cfb0d0846d4 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 200 len: 1304 microversion: 2.1 time: 0.101470 Sep 11 05:31:48.582800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 190/376] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:48 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:48.625393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:48.626033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:48.632158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.632604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.633040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.634161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.634549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.634998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.772963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:48.780768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe22189a-72ae-4c02-92e5-6dc60ac7c8ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1503 microversion: 2.1 time: 0.159451 Sep 11 05:31:48.781326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 187/377] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:48 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:48.803601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:48.804499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:48.811214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.811707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.812175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.812873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.813328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.813753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.935548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:48.936324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:48.942884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:48.944067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.944783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.945415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.946329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:48.946971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:48.947583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:48.950902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f90603b5-219f-4480-aee4-b7e860b36e9b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1515 microversion: 2.1 time: 0.151167 Sep 11 05:31:48.953502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 191/378] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:48 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:49.115847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:49.126672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-796806dd-b878-4bd0-b4ac-fda0500d2d7e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1503 microversion: 2.1 time: 0.195814 Sep 11 05:31:49.127968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 188/379] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:48 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:49.606274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:49.607180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] [instance: ec35cbab-5ce4-4e29-82fd-e2d07b19835a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:49.615139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:49.615631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:49.616167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:49.616876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:49.617340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:49.617767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:49.631639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] HTTP exception thrown: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Request method failure captured: Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a HTTP/1.1 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXKY3uwVW_GjcTnX7pMJZL6He-H-iVJ_q_SqaJeJ4uQaV2vxmlBjURvSZeRZMosd4dUqITyF_5Zqi0BVOAVXL4tHOVDA69GqrKs4d86dAhILh7CcbS2R0NsVfVrqlCE3_2TYizkWnZP_HgJ9SI5mP_e61SPgc75XUUDC8nUxEKbXRjs Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 2a9ef16092824511b11494d4388e3c58 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesNegativeTest-1221832175 Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:31:49.633128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a9ef16092824511b11494d4388e3c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a9ef16092824511b11494d4388e3c58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a9ef16092824511b11494d4388e3c58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a9ef16092824511b11494d4388e3c58"}]}] Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesNegativeTest-1221832175 Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 2a9ef16092824511b11494d4388e3c58 Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesNegativeTest-1221832175 Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesNegativeTest-1221832175-project Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: b67b9e5012f34ab4a17ab579131a986e Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesNegativeTest-1221832175-project Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. Sep 11 05:31:49.634709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'ec35cbab-5ce4-4e29-82fd-e2d07b19835a'} Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:49.635406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. Sep 11 05:31:49.636844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:31:49.637893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] Returning 404 to user: Instance ec35cbab-5ce4-4e29-82fd-e2d07b19835a could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:49.637893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3690b25-7472-4dde-9e59-750d67774916 tempest-VolumesNegativeTest-1221832175 tempest-VolumesNegativeTest-1221832175-project] 10.222.0.33 "GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a" status: 404 len: 111 microversion: 2.1 time: 0.033309 Sep 11 05:31:49.637893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 192/380] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:49 2022] GET /compute/v2.1/servers/ec35cbab-5ce4-4e29-82fd-e2d07b19835a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:49.919878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb902c-db49-46f0-aa85-11abb96de518", "name": "network-vif-deleted", "tag": "cc898bb7-7daf-4aed-aeda-a72ee689946b"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:49.934452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:49.935623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:49.936254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:49.949937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] Creating event network-vif-deleted:cc898bb7-7daf-4aed-aeda-a72ee689946b for instance 83eb902c-db49-46f0-aa85-11abb96de518 on hv-cinder-85692 Sep 11 05:31:49.955765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-19de7290-703f-471a-b9e4-5ba52dafa866 req-93575b2c-b244-4279-91d4-a9c1331d27d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039434 Sep 11 05:31:49.956400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 189/381] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:31:50.151903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:50.152630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:50.159529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.160180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.161081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.162257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.162772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.163460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.183687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:50.201665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.202152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.202783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.203523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lazy-loading 'fault' on Instance uuid 83eb902c-db49-46f0-aa85-11abb96de518 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:50.257721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:50.267769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92ee4728-ef9a-472f-82d8-cca3f214e805 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 200 len: 1303 microversion: 2.1 time: 0.120314 Sep 11 05:31:50.268552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 193/382] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:50 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:50.394912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:50.397575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:50.404051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.404787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.405423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.406318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.407003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.407565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.432473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'flavor' on Instance uuid 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:31:50.523734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-959f97d2-d652-43b5-8bee-214ea433c4fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/action" status: 200 len: 32 microversion: 2.1 time: 0.133485 Sep 11 05:31:50.524557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 190/383] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:31:50 2022] POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/action => generated 32 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 05:31:50.535924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:50.536997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:50.543905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.544103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.544544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.545249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:50.545872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:50.546358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:50.719761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:50.732389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f2609e9-71eb-4a95-a3c2-19d2ebc0fda1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.201690 Sep 11 05:31:50.733575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 194/384] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:50 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:51.294683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:51.296173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 83eb902c-db49-46f0-aa85-11abb96de518] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:51.304599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:51.305394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:51.306030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:51.307774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:51.308490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:51.309121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:51.326486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] HTTP exception thrown: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Request method failure captured: Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 HTTP/1.1 Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXKZXAFStP7ea5LNF0i9LA9C0pKjxS6sLghZBgnr20EGSHmpgnVD5IPr7-xsWIilZzFzGSf8PMyPD1QBA8qSPTTBV3Xfi31zAOsJ8tXGX10eUfGeqApe-ljE578gFnII4sB3mD860DuZS08lfk6QNyCvP-0SpiImZO5St74AUS-wkpk Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 16e859bc783a445f9b951dd2363fa0ce Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesActionsTest-1674561114 Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:31:51.328676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16e859bc783a445f9b951dd2363fa0ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16e859bc783a445f9b951dd2363fa0ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16e859bc783a445f9b951dd2363fa0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16e859bc783a445f9b951dd2363fa0ce"}]}] Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesActionsTest-1674561114 Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 16e859bc783a445f9b951dd2363fa0ce Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesActionsTest-1674561114 Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesActionsTest-1674561114-project Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 8424e74e566d4bf3b8840b5d5c20aa1f Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesActionsTest-1674561114-project Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. Sep 11 05:31:51.330011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '83eb902c-db49-46f0-aa85-11abb96de518'} Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:31:51.331596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. Sep 11 05:31:51.332923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:31:51.333905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Returning 404 to user: Instance 83eb902c-db49-46f0-aa85-11abb96de518 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:31:51.333905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bea76119-41c9-4dcc-8738-23c530491bc1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518" status: 404 len: 111 microversion: 2.1 time: 0.042084 Sep 11 05:31:51.333905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 191/385] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:51 2022] GET /compute/v2.1/servers/83eb902c-db49-46f0-aa85-11abb96de518 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:31:51.501844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1645386344", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "networks": [{"uuid": "fbad63f1-f0e1-473d-9386-3e273d0de762"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:51.580507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] validate_networks() for [('fbad63f1-f0e1-473d-9386-3e273d0de762', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:31:51.761036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:51.761656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:51.772237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:51.773881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:51.774287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:51.775000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:51.775546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:51.783481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:52.329853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:52.364953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-254c7f7c-3b0b-4f6c-83dc-18a5b64bd3b7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.606756 Sep 11 05:31:52.383813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 192/386] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:51 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:31:52.429847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:31:52.430698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:31:52.431691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:31:52.432747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:31:52.433680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:31:52.451099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:52.451608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:52.452384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:52.455103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:52.459438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:52.461380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:52.488819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Getting quotas for project 16e859bc783a445f9b951dd2363fa0ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:31:52.497155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Getting quotas for user 8424e74e566d4bf3b8840b5d5c20aa1f and project 16e859bc783a445f9b951dd2363fa0ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:31:52.514049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:31:52.517155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:31:52.606032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2e84f8e-049b-4cb3-b7a4-502bfd3bbe9f tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108255 Sep 11 05:31:52.618833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 195/387] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:31:52.626287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-097c6bcb-bf83-478f-8da6-31a7cb5bea12 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:52.628193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-097c6bcb-bf83-478f-8da6-31a7cb5bea12 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:52.728985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-097c6bcb-bf83-478f-8da6-31a7cb5bea12 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:52.741699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-097c6bcb-bf83-478f-8da6-31a7cb5bea12 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1214 microversion: 2.1 time: 0.120772 Sep 11 05:31:52.742602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 193/388] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:52 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:53.410095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:53.411347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:53.423238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:53.423764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:53.424391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:53.428437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:53.428915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:53.429327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:53.618180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:53.632360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-783f5fa6-8043-49f7-b95e-a7718e717c80 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.226162 Sep 11 05:31:53.649464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 196/389] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:53 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:53.775921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:53.777062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:53.785396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:53.789275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:53.789275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:53.789275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:53.789698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:53.790543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:53.920811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:53.929488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf7f7a22-eed8-4e08-98e6-9206cc9bc141 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1210 microversion: 2.1 time: 0.159353 Sep 11 05:31:53.930887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 194/390] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:53 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1210 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:54.661494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:54.662690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:54.670050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:54.671371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:54.671974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:54.673125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:54.673827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:54.674517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:54.832219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:54.841356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af2320fb-8f6a-404b-a104-6149c5b84502 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.186970 Sep 11 05:31:54.842132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 197/391] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:54 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:54.957028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:54.957658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:54.964827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:54.965361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:54.965837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:54.966654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:54.967120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:54.967550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:55.110042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:55.127710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4477a3da-cc4e-4572-b6ef-a91e5af9756a tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1274 microversion: 2.1 time: 0.174493 Sep 11 05:31:55.128455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 195/392] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:54 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:55.868403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:55.869017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:55.875917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:55.876746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:55.877298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:55.878318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:55.879131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:55.879767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:56.025817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:56.035023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c5320f8-2398-48d0-800a-3ff524923702 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.170714 Sep 11 05:31:56.035891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 198/393] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:55 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:56.154820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:56.155818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:56.164028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:56.164711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:56.165950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:56.167022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:56.167488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:56.167917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:56.432409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:56.441810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73111708-33e8-4fcd-9d5c-a4b4b7a27aa3 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.290799 Sep 11 05:31:56.442736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 196/394] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:56 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:56.889661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5af059-0d26-47d5-b41f-b04f4466006d", "tag": "195cc39e-585b-47e9-a645-103249f89e89"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:31:56.902208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:56.903095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:56.903780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:56.917599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] Creating event network-changed:195cc39e-585b-47e9-a645-103249f89e89 for instance 4b5af059-0d26-47d5-b41f-b04f4466006d on hv-cinder-85692 Sep 11 05:31:56.923004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-394b1768-f010-43b4-91ef-2073217b6d3e req-c6aa505e-3246-4c70-a0f4-c54579f1903c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039320 Sep 11 05:31:56.924300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 199/395] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:31:57.058950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:57.059610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:57.067462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:57.067957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:57.068425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:57.069131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:57.069586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:57.070009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:57.302037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:57.311344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5296859a-651c-46a9-9aa1-37adb1fe4478 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.256155 Sep 11 05:31:57.312029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 197/396] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:57 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:57.478816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:57.479584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:57.486283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:57.486917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:57.487381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:57.488200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:57.488751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:57.489176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:57.632419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:57.641294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f093a0ae-7056-486e-810e-c60e792ae791 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.167361 Sep 11 05:31:57.642582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 200/397] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:57 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:58.336639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:58.337328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:58.343222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:58.343694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:58.344160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:58.344870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:58.345310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:58.345730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:58.483050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:58.491148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6e3903a-21dd-4520-88c4-a865651caa0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.158341 Sep 11 05:31:58.491725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 198/398] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:58 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:58.667190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:58.667807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:58.675694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:58.676337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:58.676872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:58.677772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:58.678507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:58.678932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:58.851505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:58.860150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffc4b6d9-34b4-4cf0-a191-39f1ebffe844 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.196866 Sep 11 05:31:58.861257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 201/399] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:58 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:59.515179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:59.516128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:59.522338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:59.522825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:59.523262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:59.523954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:59.524444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:59.524867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:59.528116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:31:59.733095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:31:59.742952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48f44c9f-99cc-40c9-bcdc-75ea4784ed89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.231716 Sep 11 05:31:59.743529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 199/400] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:59 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:31:59.883809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:31:59.884473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:31:59.890690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:59.891362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:59.892439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:31:59.893338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:31:59.893793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:31:59.894220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:00.041656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:00.049622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f53ea3f-4981-43d9-b492-6c40f83cad2e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.169797 Sep 11 05:32:00.050188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 202/401] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:31:59 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:00.767640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:00.769370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:00.777754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:00.778577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:00.779195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:00.780112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:00.780602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:00.781067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:01.068338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:01.077785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:01.078561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:01.078650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d3c4450-5610-4ced-a794-88588a0c701a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.315316 Sep 11 05:32:01.084208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 200/402] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:00 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:01.090056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:01.091196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:01.092139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:01.093101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:01.093831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:01.095168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:01.286832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:01.297507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50c820bf-bbee-4ddb-986c-80cbc81bed8e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.227492 Sep 11 05:32:01.309246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 203/403] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:01 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:02.105376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:02.106001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:02.118466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:02.119012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:02.119670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:02.120895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:02.121658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:02.122236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:02.326270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:02.326879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:02.338224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:02.339257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:02.339703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:02.340464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:02.341052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:02.341468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:02.349272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:02.363663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcb87716-10c5-4db2-bc1d-61b468d0e530 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.262237 Sep 11 05:32:02.381857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 201/404] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:02 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:02.475422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:02.506222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:02.611715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:02.621030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76b20cee-7a18-40a6-93e2-74d79c12a155 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.298870 Sep 11 05:32:02.621721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 204/405] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:02 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:03.390597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:03.391432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:03.394518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:03.400141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:03.400668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:03.401183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:03.401881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:03.402550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:03.403308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:03.560167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:03.568914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0430ded-b36b-4a0f-a9dc-e5440a5750b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.182174 Sep 11 05:32:03.570562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 202/406] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:03 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:03.600912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5af059-0d26-47d5-b41f-b04f4466006d", "name": "network-vif-plugged", "status": "completed", "tag": "195cc39e-585b-47e9-a645-103249f89e89"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:03.612226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:03.613049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:03.613546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:03.627320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] Creating event network-vif-plugged:195cc39e-585b-47e9-a645-103249f89e89 for instance 4b5af059-0d26-47d5-b41f-b04f4466006d on hv-cinder-85692 Sep 11 05:32:03.632387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-32bca2d8-e736-4eaf-afb3-bf173a71f66d req-93cbb67e-0e86-477a-95ca-45a60b8b6de5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035289 Sep 11 05:32:03.633022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 205/407] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:03.647372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:03.648386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:03.655188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:03.655674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:03.656148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:03.656860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:03.657829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:03.658262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:03.792179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:03.801004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9897736-1dda-49c7-8a6a-ecf3fd89c1f8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.157592 Sep 11 05:32:03.801573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 203/408] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:03 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:04.593557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:04.594189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:04.600607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:04.601087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:04.601672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:04.602197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:04.602651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:04.603073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:04.742459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:04.750243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5efd746-6abb-4425-9418-ef5db295eba9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.161173 Sep 11 05:32:04.750802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 206/409] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:04 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:04.824553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:04.825162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:04.831676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:04.832189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:04.832624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:04.833341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:04.833798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:04.834219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:05.235330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:05.244019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26e7be48-2a7e-4fa1-a897-ba84a003efee tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1314 microversion: 2.1 time: 0.423414 Sep 11 05:32:05.244601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 204/410] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:04 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:05.775252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:05.776411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:05.783655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:05.784183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:05.784801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:05.785529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:05.785984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:05.786586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:05.963905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:05.971921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ff12bf4-31de-4c14-85a7-927d69fd4fbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1501 microversion: 2.1 time: 0.200671 Sep 11 05:32:05.972507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 207/411] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:05 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:05.997118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4efc4c51-853d-448a-8472-8641164f858e"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:05.999429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:06.007467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.007955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.008416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.009372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.009833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.010260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.033737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Cannot 'attach_volume' instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 while it is in vm_state rescued Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/os-volume_attachments HTTP/1.1 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 74 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:32:06.035332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {"volumeAttachment": {"volumeId": "4efc4c51-853d-448a-8472-8641164f858e"}} Sep 11 05:32:06.036827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Cannot 'attach_volume' instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 while it is in vm_state rescued Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '20ab1d7c-7832-4c37-9d94-7f5ed0c8be89', 'body': {'volumeAttachment': {'volumeId': '4efc4c51-853d-448a-8472-8641164f858e'}}} Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:32:06.037644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 while it is in vm_state rescued Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:32:06.038971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 while it is in vm_state rescued Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 409 to user: Cannot 'attach_volume' instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 while it is in vm_state rescued {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22491179-afd8-43b2-a5b6-ab26d0dececc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045730 Sep 11 05:32:06.040231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 205/412] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:32:05 2022] POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 11 05:32:06.046021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:06.046745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:06.052825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.053323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.053766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.054667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.055128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.055556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.121546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e69c6b5c-50bb-4478-a451-b6032af554c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/action" status: 202 len: 0 microversion: 2.1 time: 0.079082 Sep 11 05:32:06.122093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 208/413] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:32:06 2022] POST /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:32:06.131053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:06.131656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:06.137873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.138352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.138779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.139463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.139910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.140352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.269265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:06.270765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:06.272914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:06.278336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.278869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.279272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.280031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:06.280496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:06.280924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:06.281161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d6bbb55-bf30-42dc-a567-733bf45224f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1509 microversion: 2.1 time: 0.154751 Sep 11 05:32:06.281715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 206/414] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:06 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:06.423435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:06.431922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df120c45-6f9f-436b-8a3f-fddde42db8e8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1498 microversion: 2.1 time: 0.167697 Sep 11 05:32:06.432789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 209/415] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:06 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:07.164221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:07.164960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:07.172109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.173599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.174415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.175806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.176498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.177249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.205665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:32:07.305994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:07.306624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:07.317205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.317974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.320043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.320714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.321429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7cd220cf-72e8-498e-aae7-3df5a3b491b8 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 204 len: 0 microversion: 2.1 time: 0.161093 Sep 11 05:32:07.322076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.322241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 207/416] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:32:07 2022] DELETE /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 05:32:07.322504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.332240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:07.333050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:07.339307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.339910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.340417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.341203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:07.341759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:07.342264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:07.486329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:07.491426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:07.501847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd95c1cb-26e4-41cb-adc8-8213c1fa4d84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1509 microversion: 2.1 time: 0.198945 Sep 11 05:32:07.503026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 210/417] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:07 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:07.524052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:07.533422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69627462-b16d-4985-a82b-744a82f0b986 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1504 microversion: 2.1 time: 0.206239 Sep 11 05:32:07.534080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 208/418] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:07 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:08.527898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:08.528615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:08.561190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:08.561834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:08.568491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:08.569024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:08.578073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:08.578920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:08.581277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:08.582637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:08.583193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:08.584065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:08.585959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:08.587068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:08.590461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:08.593677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:08.758472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:08.766826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57479a91-4e77-4ba3-833b-195f74987a1e tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1504 microversion: 2.1 time: 0.211988 Sep 11 05:32:08.767513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 209/419] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:08 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:08.834125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:08.843712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e5f12ec3-b8e0-4559-8337-b64c1e52eeb3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1509 microversion: 2.1 time: 0.320282 Sep 11 05:32:08.844575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 211/420] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:08 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:09.791731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:09.792310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:09.805955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:09.806455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:09.807387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:09.807595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:09.808078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:09.808696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:09.869728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:09.871019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:09.878346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:09.880644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:09.881363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:09.882636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:09.884213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:09.884827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:09.885797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:10.043907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:10.052490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad5b8aa0-b91d-41a0-b2ac-04aeee62c410 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1509 microversion: 2.1 time: 0.186492 Sep 11 05:32:10.053249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 212/421] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:09 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:10.208262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:10.216308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f2fc581-11ab-4a07-a3fb-941e401596d7 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1504 microversion: 2.1 time: 0.428556 Sep 11 05:32:10.217004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 210/422] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:09 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:11.077130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:11.077792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:11.087286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:11.087989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:11.088793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:11.089766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:11.090577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:11.091172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:11.248903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:11.250399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:11.265959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:11.267223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:11.268309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:11.269436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:11.270100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:11.270678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:11.274165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:11.287733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d1ce1812-8bf4-440a-837d-a2fd18c51fe5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1509 microversion: 2.1 time: 0.215413 Sep 11 05:32:11.300026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 213/423] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:11 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:11.805317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5af059-0d26-47d5-b41f-b04f4466006d", "name": "network-vif-unplugged", "status": "completed", "tag": "195cc39e-585b-47e9-a645-103249f89e89"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:11.819304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:11.819849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:11.820381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:11.832122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] Creating event network-vif-unplugged:195cc39e-585b-47e9-a645-103249f89e89 for instance 4b5af059-0d26-47d5-b41f-b04f4466006d on hv-cinder-85692 Sep 11 05:32:11.838169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-2d6416b8-90f1-4a3d-9aea-908baa647865 req-b2d84887-0daa-405e-8ce9-b202e53f2f65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038132 Sep 11 05:32:11.839182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 214/424] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:32:11.971219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:11.982020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d7294c0-3402-456c-b731-5e82f0455d0d tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1504 microversion: 2.1 time: 0.741219 Sep 11 05:32:11.982920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 211/425] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:11 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:12.313504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:12.314423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:12.320653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:12.321354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:12.321978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:12.322844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:12.323453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:12.324067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:12.493954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:12.503841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6019bd1b-96eb-4c03-ba8f-36c005bfbd6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1515 microversion: 2.1 time: 0.194789 Sep 11 05:32:12.510027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5af059-0d26-47d5-b41f-b04f4466006d", "name": "network-vif-deleted", "tag": "195cc39e-585b-47e9-a645-103249f89e89"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:12.533228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 215/426] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:12 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:12.533704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:12.533704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:12.533704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:12.555637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] Creating event network-vif-deleted:195cc39e-585b-47e9-a645-103249f89e89 for instance 4b5af059-0d26-47d5-b41f-b04f4466006d on hv-cinder-85692 Sep 11 05:32:12.562182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-200d5f5f-6a0e-440b-8adf-ff8381e1dd3f req-0273a1fa-e56a-40fe-b07e-a54a8460d24a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056569 Sep 11 05:32:12.563692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 212/427] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:13.011495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:13.011495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:13.020056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:13.020553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:13.021127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:13.023956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:13.024456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:13.024891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:13.109137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:13.109812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:13.110926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:13.113052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lazy-loading 'fault' on Instance uuid 4b5af059-0d26-47d5-b41f-b04f4466006d {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:32:13.178849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8424e74e566d4bf3b8840b5d5c20aa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e859bc783a445f9b951dd2363fa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:13.188077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0a681390-83ae-4deb-a0d6-162c7cf346b1 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 200 len: 1304 microversion: 2.1 time: 0.184599 Sep 11 05:32:13.190154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 216/428] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:13 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:14.181858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce2ba68d-cd6e-4d93-a833-598ef587938c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: .version_select at 0x7f2c3f27ed30>, body: {"keypair": {"name": "tempest-keypair-318681437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImn8aXRzwLKhpHXrXFZhpALTEWems+rY0VgCl+a9DlXuKyIqXhY0ylrkISP7ePhoLArwTpakg1EC4kE/rCUId5i1q60N4WV05ooD7TG7qKuzbYV8Fy8HsPH4us57vX9Dg=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:14.202205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-ce2ba68d-cd6e-4d93-a833-598ef587938c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for project 60788ee7f0ab439087f63db271b65ef4. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:32:14.207807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-ce2ba68d-cd6e-4d93-a833-598ef587938c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for user f4c978e96d3248d59120c287ecc75e87 and project 60788ee7f0ab439087f63db271b65ef4. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:32:14.214095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:14.214924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] [instance: 4b5af059-0d26-47d5-b41f-b04f4466006d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:14.225044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:14.225673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:14.229668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:14.230714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:14.231821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:14.232521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:14.240607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce2ba68d-cd6e-4d93-a833-598ef587938c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063993 Sep 11 05:32:14.241911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 213/429] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:32:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:14.263936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] HTTP exception thrown: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Request method failure captured: Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d HTTP/1.1 Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXKZXAFStP7ea5LNF0i9LA9C0pKjxS6sLghZBgnr20EGSHmpgnVD5IPr7-xsWIilZzFzGSf8PMyPD1QBA8qSPTTBV3Xfi31zAOsJ8tXGX10eUfGeqApe-ljE578gFnII4sB3mD860DuZS08lfk6QNyCvP-0SpiImZO5St74AUS-wkpk Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 16e859bc783a445f9b951dd2363fa0ce Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesActionsTest-1674561114 Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:32:14.265816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16e859bc783a445f9b951dd2363fa0ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16e859bc783a445f9b951dd2363fa0ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16e859bc783a445f9b951dd2363fa0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16e859bc783a445f9b951dd2363fa0ce"}]}] Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesActionsTest-1674561114 Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 16e859bc783a445f9b951dd2363fa0ce Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesActionsTest-1674561114 Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesActionsTest-1674561114-project Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 8424e74e566d4bf3b8840b5d5c20aa1f Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesActionsTest-1674561114-project Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. Sep 11 05:32:14.268252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '4b5af059-0d26-47d5-b41f-b04f4466006d'} Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:32:14.269288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. Sep 11 05:32:14.271109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:32:14.274246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] Returning 404 to user: Instance 4b5af059-0d26-47d5-b41f-b04f4466006d could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:32:14.275368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c4288949-1b28-4038-8925-fed721d6c981 tempest-VolumesActionsTest-1674561114 tempest-VolumesActionsTest-1674561114-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d" status: 404 len: 111 microversion: 2.1 time: 0.066007 Sep 11 05:32:14.276165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 217/430] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:14 2022] GET /compute/v2.1/servers/4b5af059-0d26-47d5-b41f-b04f4466006d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 05:32:16.413174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-848738440", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292005db-ed4c-41e2-9867-8cd96d81fc55"}], "security_groups": [{"name": "tempest-securitygroup--436531518"}], "key_name": "tempest-keypair-318681437", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:16.423452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:16.595775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] validate_networks() for [('292005db-ed4c-41e2-9867-8cd96d81fc55', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:32:17.074422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:32:17.074846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:32:17.076022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:32:17.076455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:32:17.076873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:32:17.088839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:17.089610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:17.090231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:17.091405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:17.092249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:17.092985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:17.114833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:32:17.119563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Getting quotas for user f4c978e96d3248d59120c287ecc75e87 and project 60788ee7f0ab439087f63db271b65ef4. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:32:17.132345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:32:17.135442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:32:17.214617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbafd552-21b3-4056-9eeb-92eac34a54ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.806179 Sep 11 05:32:17.221235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 214/431] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:32:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:32:17.230718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49f3bd99-5eb5-4112-b378-f75759d2cac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:17.232130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49f3bd99-5eb5-4112-b378-f75759d2cac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:17.391497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49f3bd99-5eb5-4112-b378-f75759d2cac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:17.402740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49f3bd99-5eb5-4112-b378-f75759d2cac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1244 microversion: 2.1 time: 0.177279 Sep 11 05:32:17.403182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 218/432] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1244 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:18.428650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:18.429882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:18.438824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:18.439341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:18.439819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:18.440569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:18.441030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:18.441615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:18.687583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:18.697227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01c90ab6-2282-4270-a778-2d458bafb0f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1248 microversion: 2.1 time: 0.273405 Sep 11 05:32:18.697914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 215/433] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1248 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:19.722074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:19.723356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:19.733318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:19.736539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:19.737251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:19.738386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:19.739069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:19.739747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:19.815302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:19.824380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb3be19c-70c3-4a25-95b9-9738af994b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1240 microversion: 2.1 time: 0.107399 Sep 11 05:32:19.841569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 219/434] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:20.337130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5011be5-be03-44ac-9cdc-377b461e68ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Action: 'create', calling method: .version_select at 0x7f2c3f23e040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1753796652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoGQEA0wXu+b50pPzhVcDJy8y41Y4YNXeqy8cMd4QeWNfz9U0VTxF89u0DntzXAuVEnN0zxme6w2Tlpp+cpUKf4socg6W57a6ah2bgGvV3qdsxQ4A1YyDKtKP4YrUqDIw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:20.353600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d5011be5-be03-44ac-9cdc-377b461e68ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Getting quotas for project 183fd2ebaf054cfebad0bafa207f9967. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:32:20.357435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d5011be5-be03-44ac-9cdc-377b461e68ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Getting quotas for user 25cdba6a3bec49b4928b3fd953673060 and project 183fd2ebaf054cfebad0bafa207f9967. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:32:20.382421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5011be5-be03-44ac-9cdc-377b461e68ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.291620 Sep 11 05:32:20.383205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 216/435] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:32:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:20.854445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:20.855577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:20.897248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:20.902816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:20.903520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:20.904393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:20.904937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:20.905924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:21.101935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:21.112521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d623a12-2e09-466a-8b0a-ce689c36598a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1314 microversion: 2.1 time: 0.267196 Sep 11 05:32:21.130769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 220/436] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:22.140868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:22.142049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:22.152174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:22.153695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:22.154159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:22.155721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:22.164572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:22.166034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:22.610384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:22.617160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:22.624367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2f70a75-60aa-408f-994a-59aa10183b39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.487785 Sep 11 05:32:22.637007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 217/437] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:23.332376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:23.351459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:23.351964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:23.352450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:23.389847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] Creating event network-changed:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 05:32:23.400251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-e495c6d1-b00b-421d-9e9b-44beb63102c6 req-ca7c486e-db26-4356-9343-0dcbdcc97485 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071681 Sep 11 05:32:23.401218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 221/438] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:23.655545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:23.656206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:23.678600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:23.680977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:23.681624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:23.682514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:23.683669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:23.684514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:24.077865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:24.088975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8485dd6b-8aa0-47b5-a64a-ec2d92ecbe20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.439188 Sep 11 05:32:24.092689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 218/439] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:25.116863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:25.119528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:25.133603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:25.135589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:25.137574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:25.139450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:25.140382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:25.141108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:25.394115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:25.412167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8375b67-3a19-4f93-922e-b093906d72bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.297300 Sep 11 05:32:25.412167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 222/440] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:26.451182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:26.452660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:26.461827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:26.462871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:26.463766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:26.465040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:26.465752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:26.466519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:26.769717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:26.814502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32310269-585b-462b-b9e9-f30ddec05b90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.367527 Sep 11 05:32:26.817837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 219/441] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:27.848247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:27.850602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:27.862095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:27.868183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:27.868938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:27.869563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:27.870484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:27.871112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:27.871725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:28.114145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:28.131888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15edda18-250d-4b9d-8e63-fc739f2d716c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.292536 Sep 11 05:32:28.147278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 223/442] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:29.160343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:29.161866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:29.165409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:29.173077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:29.173572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:29.174016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:29.174728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:29.175191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:29.175615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:29.338532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:29.347729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd0089d6-9d51-4af0-9cb3-ade0c06aadfd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.192521 Sep 11 05:32:29.348330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 220/443] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:30.370296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:30.371581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:30.377897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:30.378384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:30.379023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:30.379729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:30.380221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:30.380655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:30.568238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:30.577182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb77e147-5cd0-4005-b09e-0f460c15e329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.210780 Sep 11 05:32:30.577763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 224/444] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:30.738086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "name": "network-vif-plugged", "status": "completed", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:30.745663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=14 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:30.751632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:30.752283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:30.752905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:30.769761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] Creating event network-vif-plugged:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 05:32:30.776341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b16b67b2-7f68-495f-bd19-7ffd44e7a71a req-6e7c4386-9af6-48fb-b4bd-fb840ce44eb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043524 Sep 11 05:32:30.777190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 221/445] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:31.601639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:31.602985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:31.610352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:31.610848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:31.611289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:31.612020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:31.612575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:31.613038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:31.783916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:31.793863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-101dff99-e748-4ecd-9eda-5d17127770b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.196307 Sep 11 05:32:31.794907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 225/446] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:32:32.822077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:32.822793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:32.829992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:32.830728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:32.831175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:32.832140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:32.832648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:32.833120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:32.986142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:32.994332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f586549-de51-4e79-ab33-a87c8f694f76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1369 microversion: 2.1 time: 0.176660 Sep 11 05:32:32.995084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 222/447] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:34.020871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:34.021424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:34.027720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:34.028238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:34.028668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:34.029349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:34.029797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:34.030215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:34.166707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:34.175816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3df72f1-95f1-472b-82fe-e114ac276cdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1563 microversion: 2.1 time: 0.158749 Sep 11 05:32:34.177055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 226/448] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:34.201740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:34.202353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:34.210855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:34.211407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:34.211965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:34.212931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:34.213570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:34.214223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:34.299938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7800c7f7-1dac-4cc9-a54b-aed35c886d99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102775 Sep 11 05:32:34.300848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 223/449] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:32:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:35.377222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:35.388942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:35.389783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:35.390553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:35.407970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] Creating event network-changed:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 05:32:35.413767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-040b743e-ebb7-4382-b98a-dd441c1bf92a req-804cb54f-6a18-495a-b56b-9b8bc6fefa9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041063 Sep 11 05:32:35.414402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 227/450] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:52.863587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:52.864689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=31 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:52.868618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2099321834", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "networks": [{"uuid": "89cc4ffd-df0e-4874-a0ee-9ef72dc5018f"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:52.934893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] validate_networks() for [('89cc4ffd-df0e-4874-a0ee-9ef72dc5018f', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:32:53.418938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:32:53.419439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:32:53.419923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:32:53.420369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:32:53.420783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:32:53.431445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:53.432114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:53.432559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:53.433309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:53.433766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:53.434193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:53.451608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Getting quotas for project bbab28318bf84c88b2f3a774defb870f. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:32:53.455913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Getting quotas for user 9793a6256764417eb3ff1a8386368801 and project bbab28318bf84c88b2f3a774defb870f. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:32:53.467883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:32:53.470728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:32:53.522984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-540cf02a-a715-4cf0-8ca1-c497a53abcc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660251 Sep 11 05:32:53.529931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 224/451] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:32:53.533710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=35 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:53.534526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=82 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:32:53.538706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2db5ae1-9005-4c88-8185-496a2d23e7ca tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:53.539419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2db5ae1-9005-4c88-8185-496a2d23e7ca tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:53.618030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2db5ae1-9005-4c88-8185-496a2d23e7ca tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:53.627268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2db5ae1-9005-4c88-8185-496a2d23e7ca tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1219 microversion: 2.1 time: 0.094440 Sep 11 05:32:53.628198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 228/452] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:53 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:54.654758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:54.655375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:54.662365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:54.662849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:54.663281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:54.664048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:54.664505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:54.664928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:54.736509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:54.744919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8ed8fe0-e28a-4c2e-9a39-e592669c0242 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1271 microversion: 2.1 time: 0.094135 Sep 11 05:32:54.745470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 225/453] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:54 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:55.770138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:55.770753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:55.777167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:55.777611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:55.778048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:55.778749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:55.779210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:55.779637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:55.841472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:55.849957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd32c0c4-3932-4738-a254-30bb1a946913 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1277 microversion: 2.1 time: 0.085196 Sep 11 05:32:55.850532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 229/454] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:55 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:56.005753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:56.006457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:56.013178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:56.013661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:56.014097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:56.014786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:56.015698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:56.016261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:56.039599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e55b69ad-49fb-48e5-a508-d58f007e673b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039560 Sep 11 05:32:56.040200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 226/455] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 05:32:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:56.692806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21e298e-8d2d-498e-bc3d-ab38260b9914", "tag": "deb2ba1c-e4db-4fc3-be6e-bff8d992c23c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:56.704433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:56.705182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:56.705839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:56.718180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] Creating event network-changed:deb2ba1c-e4db-4fc3-be6e-bff8d992c23c for instance f21e298e-8d2d-498e-bc3d-ab38260b9914 on hv-cinder-85692 Sep 11 05:32:56.724949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-21096134-f9bf-41a8-9a4e-9bda0e71125f req-81e873f0-5663-4514-8093-3e8900a8759a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035786 Sep 11 05:32:56.725548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 230/456] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:32:56.873687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:56.874290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:56.881441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:56.881919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:56.882349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:56.883038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:56.883486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:56.884194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:57.033525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:57.041191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d36c718-15c5-4354-9275-f29b0708f038 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.171315 Sep 11 05:32:57.041752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 227/457] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:56 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:58.064844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:58.065544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:58.071974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:58.072477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:58.072909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:58.073593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:58.074041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:58.074457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:58.206161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:58.213648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7603c469-9a6b-4024-9089-b165a1285e42 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.153377 Sep 11 05:32:58.214204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 231/458] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:58 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:58.488694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2a38aa1-e3c7-487e-b780-7e5920b0f0dd"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:58.491204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:58.497956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:58.498445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:58.498913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:58.499659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:58.500305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:58.500809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:58.548305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1448134316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1753796652", "security_groups": [{"name": "tempest-secgroup-smoke-1439532571"}], "block_device_mapping_v2": [{"uuid": "5f6fa272-9fbc-4135-8a42-8b281415df69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74b5bb34-3f19-4c08-a82f-763616bc8c24"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:32:58.672019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] validate_networks() for [('74b5bb34-3f19-4c08-a82f-763616bc8c24', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:32:59.262522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:32:59.263608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:32:59.264358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:32:59.264961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:32:59.266064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:32:59.274665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.275155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.275590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.276529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.276985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.277414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.294751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Getting quotas for project 183fd2ebaf054cfebad0bafa207f9967. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:32:59.298979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Getting quotas for user 25cdba6a3bec49b4928b3fd953673060 and project 183fd2ebaf054cfebad0bafa207f9967. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:32:59.362067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:32:59.364249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f6fa272-9fbc-4135-8a42-8b281415df69',volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:32:59.514632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9a18337-a2be-424a-a47b-0d1479a0b43e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.970393 Sep 11 05:32:59.515902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 232/459] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:32:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 05:32:59.520419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:59.521163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:59.527453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.527935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.528390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.529081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.529529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.531542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.674849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:59.682540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad2292fd-b5f4-4d14-ac73-1885874e93e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.165651 Sep 11 05:32:59.683091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 233/460] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:59 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:59.692112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11cadb67-16a8-4291-b930-7b785daed613 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:59.692112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11cadb67-16a8-4291-b930-7b785daed613 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:59.748280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-11cadb67-16a8-4291-b930-7b785daed613 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:32:59.755187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11cadb67-16a8-4291-b930-7b785daed613 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1095 microversion: 2.1 time: 0.071132 Sep 11 05:32:59.755873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 234/461] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:32:59 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:32:59.760791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:32:59.761352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:32:59.768414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.768847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.769283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.769978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:32:59.770432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:32:59.770851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:32:59.795063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-119cecc2-92dc-46e3-aa15-c1226cd535c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/ips" status: 200 len: 145 microversion: 2.1 time: 0.038110 Sep 11 05:32:59.795650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 235/462] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 05:32:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:00.433650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c02235fb-ae3d-4c27-b757-cda6da042b83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.948675 Sep 11 05:33:00.435543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 228/463] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:32:58 2022] POST /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 194 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:00.711554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:00.714924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:00.729254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:00.731312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:00.733364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:00.736269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:00.737541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:00.737992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:00.783217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:00.785023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:00.793691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:00.794664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:00.795305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:00.796284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:00.797113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:00.798212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:00.911102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:00.920035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3824e8a2-3d6d-41b4-9b25-d01f23b3c5cd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1193 microversion: 2.1 time: 0.144852 Sep 11 05:33:00.935789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 229/464] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:00 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1193 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:00.936186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:00.943080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7dc2927-3dad-4a57-896d-0e06a4d6c870 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.241959 Sep 11 05:33:00.947258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 236/465] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:00 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:01.943175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:01.943718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:01.950045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:01.950534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:01.950979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:01.951679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:01.952256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:01.953532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:01.967894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:01.969695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:01.977668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:01.978612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:01.979262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:01.980592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:01.981406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:01.982037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:02.122531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:02.131200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a1de05c0-ce14-401d-8b93-239f969f45e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.167645 Sep 11 05:33:02.131788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 237/466] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:01 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:02.287956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:02.295705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6462c79-40e6-47c0-a041-7e913d17ae41 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1211 microversion: 2.1 time: 0.356483 Sep 11 05:33:02.296854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 230/467] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:01 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:03.119263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e298e-8d2d-498e-bc3d-ab38260b9914", "name": "network-vif-plugged", "status": "completed", "tag": "deb2ba1c-e4db-4fc3-be6e-bff8d992c23c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:03.130854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.131524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.132657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.144397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] Creating event network-vif-plugged:deb2ba1c-e4db-4fc3-be6e-bff8d992c23c for instance f21e298e-8d2d-498e-bc3d-ab38260b9914 on hv-cinder-85692 Sep 11 05:33:03.149523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-120c9c7e-7cf4-489e-930e-5623d6f8c486 req-68ca080c-acdf-4d73-91a2-27f6543d8906 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034298 Sep 11 05:33:03.150881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 238/468] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:33:03.159805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:03.161009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:03.168914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.169692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.170260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.171927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.172928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.173431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.319818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:03.320634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:03.327185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.328751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.329349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.330182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.330703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.331232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.363138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:03.384748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17743362-65d9-4a14-8f38-99f05af5e27f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.232142 Sep 11 05:33:03.392940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 231/469] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:03 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:03.482420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:03.490914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c2fbd68-40f2-4296-86dd-1ecfb3fa5250 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.175286 Sep 11 05:33:03.491504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 239/470] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:03 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:03.502822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c14da8-f044-490c-86b4-f1cef62ed399", "tag": "093315a6-9a45-437a-9309-ab0159b8dae1"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:03.508452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:03.509534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:03.516991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.517622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.518253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.530148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] Creating event network-changed:093315a6-9a45-437a-9309-ab0159b8dae1 for instance c4c14da8-f044-490c-86b4-f1cef62ed399 on hv-cinder-85692 Sep 11 05:33:03.536475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-68426919-a36c-489d-8c90-7b1ace8a3c70 req-f7a8ea13-2670-421e-a194-a75d6c8b3533 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037822 Sep 11 05:33:03.537057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 232/471] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:33:03.795310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2546382-0373-42bc-9acb-5cd7e1c92058"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:03.798864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:03.805120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.805900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.806579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:03.807514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:03.808065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:03.809078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:04.410402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:04.411140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:04.417227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:04.417712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:04.418149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:04.418837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:04.419291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:04.419722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:04.553036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:04.560907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b336bb3d-6fb7-4917-864c-2d9f63006b50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.155936 Sep 11 05:33:04.561461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 233/472] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:04 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:33:04.566334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:04.566939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:04.572544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:04.573029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:04.573466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:04.574184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:04.574638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:04.575065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:04.708817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:04.716345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6e45110-f86f-4fd2-8881-4137c638e370 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.153403 Sep 11 05:33:04.716897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 234/473] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:04.963264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-489031c4-4edd-4923-ba51-cc0da2a91f9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171680 Sep 11 05:33:04.964097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 240/474] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:33:03 2022] POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:05.558508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:05.559052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:05.565611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.566182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.566696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.567475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.567936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.568486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.585617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:05.586671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:05.594925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2171bc4-a978-4124-a7e6-01f6a57645e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/ips" status: 200 len: 151 microversion: 2.20 time: 0.040272 Sep 11 05:33:05.595143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.595503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 235/475] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Sep 11 05:33:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:33:05.595659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.595944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.596832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.597316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.597735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.731836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:05.739223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:05.739640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7931764-ceb9-49be-bd89-1f1b6532fdbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.158820 Sep 11 05:33:05.740095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:05.746857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.747391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.747840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.748738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:05.749342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:05.749781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:05.752952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 241/476] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:05 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:05.899646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:05.907887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60c1c7d4-c120-4d61-a7a0-94b14b5732d9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.172681 Sep 11 05:33:05.908670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 236/477] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:05 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:33:06.764572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:06.765277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:06.771419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:06.771904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:06.772382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:06.773075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:06.773527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:06.773953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:06.903591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:06.911569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23ec1f7a-2ca7-4122-8403-a9b7e10ce86e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.151244 Sep 11 05:33:06.912151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 242/478] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:06 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:06.930428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:06.931075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:06.937646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:06.938136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:06.938581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:06.939275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:06.939730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:06.940188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:07.073342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:07.081752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea2726da-6b25-469e-ba1b-420cb947ae3e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.155068 Sep 11 05:33:07.082305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 237/479] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:06 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:07.934644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:07.935254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:07.942450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:07.942933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:07.943368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:07.944080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:07.944535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:07.944960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:08.074805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:08.082586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b094ed0d-8227-4748-968e-781952653d60 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.151832 Sep 11 05:33:08.083150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 243/480] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:07 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:08.105049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:08.105706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:08.112822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:08.113306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:08.113744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:08.114435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:08.114892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:08.115317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:08.246831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:08.254660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8df0220f-42c2-48a9-a544-200a0bda380e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.153400 Sep 11 05:33:08.255215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 238/481] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:08 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:09.104826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:09.105522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:09.112113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:09.112591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:09.113021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:09.113715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:09.114161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:09.114577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:09.251213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:09.258843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7261b9b-d251-4cc2-af8e-174c94a0e875 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1319 microversion: 2.1 time: 0.157802 Sep 11 05:33:09.259656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 244/482] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:09 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:09.277457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:09.278104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:09.284878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:09.285364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:09.285801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:09.286497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:09.286956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:09.287385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:09.421938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:09.430223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ba429bb-676d-41e2-8b1f-853559f5f304 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.156369 Sep 11 05:33:09.430934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 239/483] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:09 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:10.283648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:10.284283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:10.286238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:10.287600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:10.294803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.295291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.295727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.296723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.297306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.297730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.439800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:10.448296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccb08228-5efe-4f83-bc8f-7f58554e43c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1508 microversion: 2.1 time: 0.169361 Sep 11 05:33:10.449178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 245/484] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:10 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:10.454761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:10.455377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:10.462242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.462729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.463347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.464081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.464642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.465079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.614510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:10.624940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2127b408-5f12-4b29-8adf-977381191656 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.174315 Sep 11 05:33:10.625656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 240/485] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:10 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:10.810331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:10.811524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:10.821702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.822771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.824110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.825893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:10.827856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:10.829025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:10.855349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lazy-loading 'flavor' on Instance uuid 2851309b-4933-4d3c-950d-e9d28f857dfe {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:33:10.957906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:11.187311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c4d5b97-60e9-44c4-a782-974dc763a78c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.382441 Sep 11 05:33:11.194095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 246/486] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 11 05:33:10 2022] POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 05:33:11.198881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:11.199608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:11.213342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:11.213846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:11.214286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:11.214997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:11.215453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:11.222202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:11.231420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:11.456926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-313bc14e-ecb9-4d10-b7a2-ecaf701953b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: .version_select at 0x7f2c3f2cd430>, body: {"keypair": {"name": "tempest-keypair-1011234736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNIYg07G2vDKCbXGPACEDaQDe7UkpV1OcUpYD1xKOxy8cLiPYfUmW1/Yc5TPW6LqPwooAngl35gJwE7SEI7OmmcLpUat40ftQF1dQgzYKM2ckCRa/eU13+Jl0n+iK7w1Q=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:11.484862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-313bc14e-ecb9-4d10-b7a2-ecaf701953b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:33:11.490347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-313bc14e-ecb9-4d10-b7a2-ecaf701953b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:33:11.503712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:11.517078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:11.519027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:11.520596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38066d3a-ebfa-4910-87f7-8a915eaae242 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.325583 Sep 11 05:33:11.521478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 241/487] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:11.559780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-313bc14e-ecb9-4d10-b7a2-ecaf701953b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108113 Sep 11 05:33:11.560672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 247/488] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:33:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:11.650294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:11.650917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:11.657545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:11.658035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:11.658471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:11.659172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:11.659621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:11.660066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:11.879206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:11.893360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92187301-9108-43b0-a256-278698af22d2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.246855 Sep 11 05:33:11.895034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 242/489] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:11 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:12.547900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:12.548824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:12.555649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:12.556260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:12.556702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:12.557579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:12.558049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:12.558475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:12.774079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:12.782767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:12.784306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:12.785475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e1ff214-26e7-4fdd-be93-8785e035f696 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.242628 Sep 11 05:33:12.786027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 248/490] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:12.923756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:12.925863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:12.935461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:12.935963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:12.937292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:12.938253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:12.938992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:12.939474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:13.013567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-792004831", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42ad47aa-0576-4a66-864b-0cf4e79a54c6"}], "security_groups": [{"name": "tempest-securitygroup--1217929347"}], "key_name": "tempest-keypair-1011234736", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:13.122746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:13.138938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef0d5abf-0826-440f-b91b-5894d4d95c04 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1279 microversion: 2.1 time: 0.220467 Sep 11 05:33:13.140073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] validate_networks() for [('42ad47aa-0576-4a66-864b-0cf4e79a54c6', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:33:13.140198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 243/491] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:12 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:13.543328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:33:13.545318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:33:13.546442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:33:13.546984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:33:13.547687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:33:13.557031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:13.557648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:13.558066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:13.558859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:13.559383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:13.559898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:13.576656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:33:13.580833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:33:13.591633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:33:13.594782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:33:13.643622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-469b2d9d-5f29-4b1b-8a6b-d88e2923488e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.634622 Sep 11 05:33:13.644354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 249/492] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:33:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:33:13.656223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72a327f2-386c-44d8-875b-5449e37f29e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:13.657058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72a327f2-386c-44d8-875b-5449e37f29e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:13.710156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72a327f2-386c-44d8-875b-5449e37f29e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:13.716947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72a327f2-386c-44d8-875b-5449e37f29e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1241 microversion: 2.1 time: 0.065481 Sep 11 05:33:13.717513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 244/493] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:13 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:13.810800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:13.811521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:13.818384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:13.818869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:13.819311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:13.820028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:13.820490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:13.820919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:13.960121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:13.972372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:13.974179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:13.976279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-173af975-f614-4050-bd6d-4cd1ad2a8cd8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.169264 Sep 11 05:33:13.976911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 250/494] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:14.162471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:14.163124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:14.170472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:14.170995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:14.172192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:14.172903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:14.173366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:14.173796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:14.306618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:14.314806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c42719d-293d-4bf9-94a6-1af37e4eb12d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.156203 Sep 11 05:33:14.315359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 245/495] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:14 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:14.740644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:14.741499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:14.747960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:14.748472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:14.748991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:14.750811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:14.751264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:14.751717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:14.817293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:14.825162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6a22926-8b8b-4d52-9e6b-9ecde77b42f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1237 microversion: 2.1 time: 0.088773 Sep 11 05:33:14.825657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 251/496] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:14 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:15.002040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:15.002958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:15.011062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.011686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.012236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.013051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.013620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.014116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.155549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:15.163820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:15.165415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:15.166772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6e165e8-4922-40ba-8f27-5864dff64701 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.169456 Sep 11 05:33:15.167528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 246/497] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:15.338277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:15.338825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:15.345507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.345990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.346428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.347118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.347574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.348019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.484584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:15.492840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c61c6ce2-8f78-4dbe-9810-0bd3786287bd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.158548 Sep 11 05:33:15.493522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 252/498] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:15 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:15.852760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:15.854007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:15.867450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.867951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.869203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.870121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:15.870652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:15.871145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:15.952903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:15.961717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-275f0032-a383-4896-98d9-c0ff8d5a9ed8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1311 microversion: 2.1 time: 0.117119 Sep 11 05:33:15.962562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 247/499] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:15 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:16.204832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:16.205747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:16.213101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:16.213733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:16.214233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:16.215393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:16.216130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:16.216766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:16.377220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:16.385494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:16.386849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:16.388018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee4a2a58-86b3-4a2e-92be-3c6247f793af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.200323 Sep 11 05:33:16.388583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 253/500] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:16.517301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:16.518019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:16.525114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:16.526148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:16.527468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:16.529406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:16.530152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:16.531642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:16.721918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:16.730138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18a5aa6b-092a-411b-8e14-6cf42466544a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.217882 Sep 11 05:33:16.740055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 248/501] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:16 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:16.987036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:16.987642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:16.990835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:16.996767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:16.997510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:16.997943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:16.999229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.000596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.001222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.141005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:17.148712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-182784f0-32c2-43ca-a98b-d3ea888030e3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.166821 Sep 11 05:33:17.149325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 254/502] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:16 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:17.414914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:17.415519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:17.423108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.423729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.424200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.424897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.425350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.425778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.636328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:17.647056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:17.648877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:17.650047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d76f99e6-be49-4a53-97e8-c867cac5b48e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.239093 Sep 11 05:33:17.650608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 249/503] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:17.661977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2d846a-e822-4339-959c-f0bf2303c954", "tag": "4672c306-0b8f-4269-889c-67700ff9caba"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:17.673856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.674426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.674776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.688897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] Creating event network-changed:4672c306-0b8f-4269-889c-67700ff9caba for instance 5b2d846a-e822-4339-959c-f0bf2303c954 on hv-cinder-85692 Sep 11 05:33:17.693734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-7a354ea2-db51-4a8f-b551-4b1e2c100e39 req-8406752b-f06d-40ac-bf44-4ffb2f816223 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035394 Sep 11 05:33:17.694325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 255/504] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:17.753594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:17.754380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:17.760671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.761165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.761609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.762310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:17.762774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:17.763206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:17.978443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:17.986275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f87c00f-d17b-4869-98ff-140cab19ffde tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.237010 Sep 11 05:33:17.986849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 250/505] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:17 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:18.172984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:18.174288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:18.180565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:18.181128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:18.181636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:18.182414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:18.182935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:18.183459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:18.321897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:18.330404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2dcc9d45-12ae-4a66-b43e-b5e87682a85e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.161683 Sep 11 05:33:18.330959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 256/506] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:18 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:18.679322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:18.679862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:18.686237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:18.687206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:18.687496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:18.688209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:18.688665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:18.689090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:18.824299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:18.833030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:18.834497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:18.835669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7e4e14b-9d2c-4c2c-9808-3b2d7e5a511c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.160311 Sep 11 05:33:18.836257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 251/507] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:19.009988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:19.010517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:19.016839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.017339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.017768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:19.018468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.018928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.019357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:19.150568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:19.158884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-880209c1-3de1-48db-abf2-8854943f7612 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.153132 Sep 11 05:33:19.159442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 257/508] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:19 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:19.353446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:19.354062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:19.360406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.360899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.361339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:19.362037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.362493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.362921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:19.498297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:19.506687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cb42b63-5b0e-490f-9fd6-425b7d223952 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.156984 Sep 11 05:33:19.507254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 252/509] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:19 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:19.862258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:19.862907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:19.869228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.869718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.870160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:19.870866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:19.871314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:19.871705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:20.004559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:20.013066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:20.015006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:20.016207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-063265b4-da2f-4f75-b3d4-f87c5dc54da6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.157817 Sep 11 05:33:20.016766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 258/510] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:20.181776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:20.182388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:20.190017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:20.190515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:20.190937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:20.191620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:20.192107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:20.192538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:20.325314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:20.334640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d57a00f6-05f8-47bd-a732-1fcb47bf862e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.156617 Sep 11 05:33:20.335213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 253/511] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:20 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:20.531051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:20.531659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:20.538098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:20.538598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:20.539059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:20.540192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:20.540832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:20.541369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:20.675351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:20.682828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab307693-7c5f-4cd1-82c2-18210a2094ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.155931 Sep 11 05:33:20.683378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 259/512] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:20 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:21.044310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:21.045141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:21.052118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.052728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.053371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.054207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.054760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.055254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.183907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:21.192749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:21.194229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:21.195382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56c574aa-967f-4756-935f-415b762809a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.156234 Sep 11 05:33:21.195941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 254/513] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:21.357458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:21.358073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:21.364287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.364772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.365210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.365904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.366360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.366788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.498781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:21.507366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cf45015-1485-4ae2-9ce3-eff7bd8b56f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.153663 Sep 11 05:33:21.507947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 260/514] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:21 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:21.707380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:21.708058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:21.714499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.715016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.715435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.716176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:21.716635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:21.717094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:21.864014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:21.871563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02b082c5-558d-47d0-bd83-69fafae6adef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.168344 Sep 11 05:33:21.872137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 255/515] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:21 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:22.221943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:22.222545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:22.228963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.229441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.229871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:22.230549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.231180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.231602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:22.363962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:22.372984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:22.374727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:22.375937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d9f05f0-838e-49d8-ba4d-2e36f3a690dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.158597 Sep 11 05:33:22.376562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 261/516] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:22.530627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:22.531235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:22.538551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.539141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.539666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:22.540394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.540863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.541287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:22.691375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:22.699146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e01e2413-8775-4170-840c-b3ff043b0013 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.172423 Sep 11 05:33:22.699803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 256/517] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:22 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:22.894871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:22.895402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:22.901384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.901872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.902312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:22.903002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:22.903458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:22.903886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.035787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:23.043301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7757889b-6c58-4521-8d13-a59f5a69ed54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.152411 Sep 11 05:33:23.043853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 262/518] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:22 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:23.402790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:23.403496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:23.406196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:23.411944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:23.412621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:23.413062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.413763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:23.414254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:23.414890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.550278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:23.558317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:23.559737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:23.560907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1492df11-7817-4491-8a96-4bd52cbb3e5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.162807 Sep 11 05:33:23.561579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 257/519] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:23.722871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:23.723573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:23.726038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:23.726790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:23.733622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:23.734430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:23.734873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.735559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:23.736019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:23.736449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.882550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:23.892850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e111844-7998-47a1-a3d5-c287d0015fb0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.173687 Sep 11 05:33:23.893832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 263/520] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:23 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:33:23.940429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2d846a-e822-4339-959c-f0bf2303c954", "name": "network-vif-plugged", "status": "completed", "tag": "4672c306-0b8f-4269-889c-67700ff9caba"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:23.946051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:23.954174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:23.954658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:23.955085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:23.966265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] Creating event network-vif-plugged:4672c306-0b8f-4269-889c-67700ff9caba for instance 5b2d846a-e822-4339-959c-f0bf2303c954 on hv-cinder-85692 Sep 11 05:33:23.972218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e3434332-7957-4f5a-ae16-b29e38c1eda8 req-24a32404-527d-4c59-ab65-58abc3209f7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035726 Sep 11 05:33:23.972860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 258/521] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:24.066726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:24.067356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:24.073235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.073710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.074144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:24.074825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.075272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.075690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:24.094622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:24.210931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:24.219272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d323b984-d4ec-4315-beec-59e90ea99d40 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.156410 Sep 11 05:33:24.219831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 264/522] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:24 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:24.588269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:24.589767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:24.597237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.598108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.598812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:24.599632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.600324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.600920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:24.620491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:24.816936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:24.826841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:24.829097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:24.830268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82eb6c97-1ea9-41a2-80d4-7a3c6c77bce5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.247545 Sep 11 05:33:24.830813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 259/523] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:24.916018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:24.916666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:24.923584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.924093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.924530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:24.925213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:24.925667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:24.926089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:25.065657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:25.074043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a658b45f-3f3c-4ff1-abd6-5968c4e43fca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.161849 Sep 11 05:33:25.074625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 265/524] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:24 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:25.242787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:25.243407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:25.250373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:25.251695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:25.251695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:25.252056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:25.252731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:25.253360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:25.493359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:25.501227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cfe697f-c9fe-4581-ba0e-56ad6eb1a452 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.262372 Sep 11 05:33:25.501790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 260/525] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:25 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:25.854839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:25.855469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:25.861679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:25.862154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:25.862585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:25.863272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:25.863719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:25.864179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.015105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.023536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.025019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.033054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db604590-829e-4529-94dd-8d059f44600e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.182003 Sep 11 05:33:26.033651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 266/526] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:26.097396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:26.098014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:26.104375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.104857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.105295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.106015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.106471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.106898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.242884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.251301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-587702b8-7e48-4d7d-93e9-1dfd30109fa7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.157736 Sep 11 05:33:26.251872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 261/527] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:26 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:26.365447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:26.371300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.371785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.372261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.437551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Going to try to stop instance {{(pid=120644) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 05:33:26.483324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07912dce-d69e-479e-ad30-d037700206e6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action" status: 202 len: 0 microversion: 2.1 time: 0.121505 Sep 11 05:33:26.483969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 267/528] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:33:26 2022] POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:33:26.492294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:26.492907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:26.499971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.500485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.500921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.501621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.502077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.502501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.525033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:26.525726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:26.531859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.532373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.532803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.533486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:26.533936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:26.534355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:26.658949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.668808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5e59635-b8df-4fd1-905f-619fe56a10d1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.180317 Sep 11 05:33:26.669559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 262/529] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:26.694137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:26.702618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca36b4ed-921b-482d-9686-9282876df059 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1367 microversion: 2.1 time: 0.181699 Sep 11 05:33:26.703312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 268/530] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:26 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:27.057487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:27.058032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:27.064374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.064854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.065283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.065969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.066452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.066874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.196644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.205015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.206557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.207894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14474a6a-e144-4eda-990f-bf04839679f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.154290 Sep 11 05:33:27.208501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 263/531] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:27.274869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:27.275505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:27.282557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.283040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.283482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.284209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.284674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.285108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.422548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.430472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92a0277b-8f45-4316-89a3-ff2e6dcf1ac1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.159305 Sep 11 05:33:27.431082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 269/532] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:27 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:27.693253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:27.693780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:27.699932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.700439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.700870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.701555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.702804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.703330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.726424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:27.727133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:27.733037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.733511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.733946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.734633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.735086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.735508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.840984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.850296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-deb4e3f4-3a84-4c01-826f-06320b6d8454 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.160942 Sep 11 05:33:27.850868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 264/533] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:27.875151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:27.882993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf302fe3-db26-44af-8d10-627690d61fd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1556 microversion: 2.1 time: 0.160321 Sep 11 05:33:27.883740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 270/534] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:27 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:27.908448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:27.908947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:27.915239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.915798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.916421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:27.917304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:27.917766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:27.918189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.004339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-213c8c9d-a5a8-41c3-bf69-ff7aeeca28b6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100691 Sep 11 05:33:28.004943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 265/535] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:33:27 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:28.234529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:28.235191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:28.241075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.241550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.241979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.242660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.243111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.243529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.382388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:28.390903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:28.392375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:28.393622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef8954c5-2e1c-4e48-a3e0-114f855293c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1723 microversion: 2.20 time: 0.163891 Sep 11 05:33:28.394403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 271/536] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:28.457555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:28.458154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:28.464639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.465117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.465547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.466235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.466738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.467113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.684426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:28.692747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6d1ecbd-8ec2-4583-ab32-6abe3054937d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.242207 Sep 11 05:33:28.693317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 266/537] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:28 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:28.874566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:28.875190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:28.882020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.882504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.882941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:28.883643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:28.884573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:28.884821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.078539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c14da8-f044-490c-86b4-f1cef62ed399", "name": "network-vif-plugged", "status": "completed", "tag": "093315a6-9a45-437a-9309-ab0159b8dae1"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:29.100069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.100552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.100992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.107276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:29.116127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] Creating event network-vif-plugged:093315a6-9a45-437a-9309-ab0159b8dae1 for instance c4c14da8-f044-490c-86b4-f1cef62ed399 on hv-cinder-85692 Sep 11 05:33:29.122047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ba6af47f-af45-4d25-ad8c-605ee6a9aa21 req-ec2d6a85-b3d6-4bea-bb07-bc2842869860 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048764 Sep 11 05:33:29.123120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 267/538] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:33:29.128735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2d846a-e822-4339-959c-f0bf2303c954", "tag": "4672c306-0b8f-4269-889c-67700ff9caba"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:29.132336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3af715fb-92ee-42f4-8394-a773e1467079 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.262337 Sep 11 05:33:29.140087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.140580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.141016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.152833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] Creating event network-changed:4672c306-0b8f-4269-889c-67700ff9caba for instance 5b2d846a-e822-4339-959c-f0bf2303c954 on hv-cinder-85692 Sep 11 05:33:29.153654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 272/539] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:29.158333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b288c24a-e0e0-4b99-aa61-19f7a0848aa2 req-e75ead55-a953-42ae-9755-9ce7e8927ef2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Sep 11 05:33:29.158921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 268/540] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:29.421129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:29.422514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:29.430612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.431921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.432794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.434078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.434778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.435476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.585796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:29.595690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:29.597522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:29.598738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e2e57ca-519b-4d3b-ad0a-4f3dc7715a37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.182456 Sep 11 05:33:29.612066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 273/541] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:29.717638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:29.719303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:29.725123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.725638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.726084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.726789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:29.727249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:29.727678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:29.869136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:29.878474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0f002d6-a606-4916-adc9-b5d40760ab5e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.165829 Sep 11 05:33:29.879053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 269/542] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:29 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:30.163781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:30.164470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:30.171594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.172125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.172592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:30.173312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.173766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.174192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:30.318589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:30.331338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c173c5f3-6276-40c1-8f46-6d1892b9145d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.169101 Sep 11 05:33:30.343976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 274/543] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:30.624950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:30.625564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:30.631432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.631923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.632388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:30.633075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.633531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.633958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:30.765504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:30.773551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:30.775025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:30.776200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99d686b7-857d-478d-af79-9f5ba2f37d39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.155156 Sep 11 05:33:30.776757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 270/544] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:30.901740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:30.902445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:30.908906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.909419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.909882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:30.910561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:30.911017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:30.911440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:31.051097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:31.059192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75f40963-1915-4ea8-ad30-02a0d31b7f38 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1267 microversion: 2.1 time: 0.161310 Sep 11 05:33:31.060121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 275/545] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:30 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:31.356260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:31.356880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:31.363416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:31.363909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:31.364388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:31.365089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:31.365564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:31.365985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:31.531864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:31.543282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11fbcaeb-0e03-49a7-a393-cb4a157b7d1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.190554 Sep 11 05:33:31.543818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 271/546] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:31.800685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:31.801218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:31.807420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:31.807754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:31.808233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:31.808933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:31.809427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:31.809878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:31.946815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:31.956288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:31.957943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:31.959459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-072d123a-3068-485a-b754-321c08381e8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.162729 Sep 11 05:33:31.960208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 276/547] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:32.084087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:32.084741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:32.091149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.091638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.092113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.093364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.093819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.094247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.231235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:32.238953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ec180f8-8456-43a2-8a9f-eb7130beb0f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1455 microversion: 2.1 time: 0.158813 Sep 11 05:33:32.239507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 272/548] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:32.262566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:32.263193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:32.269859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.270346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.270789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.271491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.271950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.272562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.408194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:32.415677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09612bf6-11e8-49a3-b052-5761a732d6f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1455 microversion: 2.1 time: 0.157335 Sep 11 05:33:32.416258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 277/549] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:32.567608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:32.568245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:32.574050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.574610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.574960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.575651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:32.576129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:32.576656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:32.791377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:32.800627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-428b6055-31d0-42b1-83b1-d7c0525830a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.236771 Sep 11 05:33:32.801412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 273/550] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:32.990417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:32.991678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:32.999635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:33.000325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:33.000908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:33.001731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:33.002556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:33.003309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:33.023770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "name": "network-vif-plugged", "status": "completed", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:33.041248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:33.041978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:33.055674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:33.076214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] Creating event network-vif-plugged:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:33:33.086048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-be173e89-044f-4753-8fb4-09a611cb1d1f req-021714fd-0275-4006-9d53-33c94a8a228c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068029 Sep 11 05:33:33.089021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 274/551] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:33:33.174621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:33.182836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:33.184315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:33.185552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4e2c52a-84db-45c1-be7f-95623247d243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.202993 Sep 11 05:33:33.186344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 278/552] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:33.825578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:33.826291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:33.833334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:33.833833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:33.834492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:33.835357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:33.835826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:33.836289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:34.067938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:34.077461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a18e80f2-295e-4c9a-9009-525485840d0e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.256723 Sep 11 05:33:34.078189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 275/553] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:34.211282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:34.211894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:34.219674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:34.220161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:34.220597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:34.221293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:34.221746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:34.222166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:34.370999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:34.379144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:34.380625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:34.381789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4d7d569-a27e-476f-9bdd-c02ca9475629 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.174431 Sep 11 05:33:34.382337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 279/554] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:34.634715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c14da8-f044-490c-86b4-f1cef62ed399", "tag": "093315a6-9a45-437a-9309-ab0159b8dae1"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:34.644702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:34.645270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:34.645801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:34.657047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] Creating event network-changed:093315a6-9a45-437a-9309-ab0159b8dae1 for instance c4c14da8-f044-490c-86b4-f1cef62ed399 on hv-cinder-85692 Sep 11 05:33:34.662167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ef718346-2e5c-4ca3-92e3-d2173d682f44 req-9c2f2423-4f86-4e3c-8ca3-3a096903ceb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031456 Sep 11 05:33:34.662751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 276/555] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:35.108477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:35.109645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:35.120177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:35.121058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:35.122126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:35.123075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:35.123916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:35.124947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:35.132717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:35.284166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:35.292747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f2e4bad2-4e63-4bbd-90d5-92e4a354d0a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.193573 Sep 11 05:33:35.293309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 280/556] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:35.408351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:35.409178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:35.415921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:35.416517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:35.417048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:35.417829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:35.418368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:35.418874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:35.558048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:35.566903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:35.568694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:35.569906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a632d1f3-5bb3-4d9f-bed0-534044bbc14d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.167040 Sep 11 05:33:35.570460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 277/557] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:36.316817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:36.317420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:36.323886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:36.324430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:36.324860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:36.325577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:36.326030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:36.326960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:36.460480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:36.469497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-555ad770-20a4-49fd-80a0-70be3f13cd9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.156525 Sep 11 05:33:36.470070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 281/558] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:36.596294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:36.596907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:36.603635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:36.604168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:36.604607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:36.605297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:36.605753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:36.606209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:36.739221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:36.747219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:36.749197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:36.750353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2b3a485-8cf0-4632-a49a-20ae9e7930b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.158790 Sep 11 05:33:36.750906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 278/559] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:37.492838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:37.493457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:37.500149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:37.500643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:37.501086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:37.502106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:37.502248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:37.502679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:37.630619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:37.639001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7459a9de-b547-4b04-acd5-9922b4d7477b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.149992 Sep 11 05:33:37.639563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 282/560] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:37.776356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:37.776895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:37.783922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:37.784445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:37.784883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:37.785582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:37.786038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:37.786467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:37.790698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:37.916649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:37.924664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:37.926103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:37.927245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2669495a-5764-4ff8-afad-214eb70881ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.154928 Sep 11 05:33:37.927797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 279/561] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:38.661446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:38.662058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:38.668473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:38.668958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:38.669395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:38.670663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:38.671147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:38.671571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:38.800413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:38.808586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-91b82c80-bf3b-4677-91b5-021f26f28c0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.150948 Sep 11 05:33:38.809151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 283/562] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:38.952201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:38.952815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:38.959188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:38.959669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:38.960130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:38.960819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:38.961273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:38.961696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:39.088117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:39.096907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:39.098415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:39.099578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acacb3ca-ccc1-42ce-a589-d291c730eb48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1744 microversion: 2.20 time: 0.151410 Sep 11 05:33:39.100150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 280/563] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:39.833186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:39.833791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:39.840366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:39.840845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:39.841275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:39.842883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:39.843343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:39.843764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:39.969933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:39.978052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d4077ab4-e146-4bea-ad23-7a5e7de696ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.148687 Sep 11 05:33:39.978613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 284/564] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:40.125851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:40.126677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:40.133455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:40.133936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:40.134832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:40.135520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:40.135970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:40.136413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:40.269630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:40.277782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:40.279233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:40.280851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-315e5a26-ec19-4648-b567-bc9bcac93110 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.159342 Sep 11 05:33:40.281386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 281/565] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:41.002598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:41.003211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:41.010209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:41.010701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:41.011347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:41.012255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:41.012885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:41.013322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:41.153328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:41.162198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7f47324-a9ce-4fb5-b70c-a5e59ebb42b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.163715 Sep 11 05:33:41.162742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 285/566] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:41.306950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:41.307610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:41.315094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:41.315581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:41.316049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:41.316759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:41.317229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:41.317828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:41.454956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:41.463654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:41.465137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:41.466301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb53d724-d15c-45b7-ace3-3f3bbad45f5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.163543 Sep 11 05:33:41.466912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 282/567] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:42.185265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:42.186733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:42.194411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:42.194898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:42.195335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:42.196054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:42.196611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:42.197036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:42.332700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:42.340855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-19036061-8423-4c3e-97eb-37c170232ab0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.159439 Sep 11 05:33:42.341423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 286/568] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:42.491482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:42.493813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:42.502007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:42.502585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:42.503093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:42.504061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:42.504588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:42.505214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:42.649592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:42.660194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:42.662011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:42.663631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b2482cc-7d4e-47f7-bd46-91f040f0029a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.176332 Sep 11 05:33:42.664215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 283/569] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:43.364114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:43.364709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:43.371174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:43.371659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:43.372131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:43.372828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:43.373285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:43.373802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:43.512735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:43.521001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39d9e141-13a4-45e7-a472-c78987ac74f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.160818 Sep 11 05:33:43.521559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 287/570] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:43.694962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:43.695485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:43.704604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:43.705119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:43.705560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:43.706264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:43.706718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:43.707141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:43.853261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:43.862042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:43.863471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:43.864663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd3c6acd-8636-48f0-a7d5-0b8fc0894930 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.173799 Sep 11 05:33:43.865361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 284/571] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:44.545356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:44.546376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:44.552818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:44.553306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:44.553744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:44.554439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:44.554893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:44.555315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:44.691415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:44.699733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3b5dd63-c814-48d8-8bae-fa5dc61b2a5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.159064 Sep 11 05:33:44.700325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 288/572] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:44.889434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:44.890327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:44.896737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:44.897217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:44.897649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:44.898897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:44.899100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:44.899601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:45.041968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:45.050048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:45.051470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:45.052707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b98bb024-6bf5-41c5-8546-fdeaf7dccd7b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.167691 Sep 11 05:33:45.053201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 285/573] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:45.723502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:45.724173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:45.731893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:45.733428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:45.734427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:45.735315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:45.735868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:45.736396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:45.869987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:45.878237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed4be6ee-5fd8-4312-a945-32086ce749ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.158839 Sep 11 05:33:45.878811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 289/574] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:46.079710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:46.080440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:46.086800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:46.087287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:46.087729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:46.088657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:46.089118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:46.089548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:46.224330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:46.232839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:46.234239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:46.235414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58a4af46-e8da-44b2-afc7-537e1eec9a95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.160552 Sep 11 05:33:46.236011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 286/575] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:46.901414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:46.902021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:46.912031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:46.912546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:46.913221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:46.914185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:46.914866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:46.915834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:47.075297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:47.083942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41c54683-49bb-4484-941a-7cbdf3e0f645 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1723 microversion: 2.1 time: 0.186321 Sep 11 05:33:47.084723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 290/576] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:47.263619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:47.265291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:47.272524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:47.273029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:47.273472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:47.274207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:47.274673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:47.275108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:47.441486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:47.457191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:47.458761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:47.460782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a890b67-5145-4e15-acf8-37b64d55d143 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.201705 Sep 11 05:33:47.461452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 287/577] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:48.108683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:48.109433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:48.111713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=73 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:48.118449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.118943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.119580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.120463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.121069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.121648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.270025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:48.280709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-393eb3a9-4f0d-472a-9326-eb747b8b63b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1700 microversion: 2.1 time: 0.176829 Sep 11 05:33:48.281288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 291/578] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:48.305195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:48.314136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.314635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.315073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.384678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Going to try to start instance {{(pid=120643) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 05:33:48.429572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53295a2c-d563-4d26-9a49-7c2118b2a66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action" status: 202 len: 0 microversion: 2.1 time: 0.128566 Sep 11 05:33:48.430174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 288/579] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:33:48 2022] POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:33:48.439831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:48.440777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:48.446859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.447354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.447799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.448606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.449071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.449503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.487728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:48.488471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:48.495332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.495823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.496283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.496985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:48.497489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:48.498127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:48.594432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:48.603219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d89967c8-81ce-4116-ad1e-de4388aa0488 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1709 microversion: 2.1 time: 0.168703 Sep 11 05:33:48.603800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 292/580] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:48.651435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:48.661304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:48.662765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:48.664187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afd1632c-ab30-478e-ac16-44dd8809779e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.181816 Sep 11 05:33:48.664733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 289/581] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:49.235718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bc0f9e3-2c7d-43ad-9656-f98703473afe", "device": "/dev/sdb"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:33:49.240193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:49.247717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.248970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.249711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.250440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.250898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.251572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.562417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0a9d24d4-cf05-44eb-9b64-4c51347819f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "POST /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331979 Sep 11 05:33:49.563397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 293/582] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:33:49 2022] POST /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:33:49.628911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:49.630238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:49.637773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.638258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.638973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.639908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.640406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.640839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.690618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:49.691488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:49.698843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.699643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.700342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.701355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:49.702457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:49.703094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:49.786209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:49.795871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-021b6178-1356-4ba3-b2d9-73afa3f414ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1709 microversion: 2.1 time: 0.172582 Sep 11 05:33:49.796481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 290/583] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:49.861392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:49.869514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:49.870972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:49.872288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f4d6f252-4c80-488b-8cd4-87b20625af83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.186286 Sep 11 05:33:49.873598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 294/584] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:50.821756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:50.822425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:50.829299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:50.829792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:50.830230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:50.831128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:50.831441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:50.831875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:50.900675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:50.901213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:50.910165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:50.913997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:50.914462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:50.915188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:50.915642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:50.916089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:50.952963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:50.989773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:50.998717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dfd4e7e1-f70f-4dae-9ba5-67f1fe108772 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1709 microversion: 2.1 time: 0.181978 Sep 11 05:33:51.015503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 291/585] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1709 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:51.069863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:51.078848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:51.080318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:51.081486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8227b11-2540-4836-8195-4ef2e4e487c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.184786 Sep 11 05:33:51.082038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 295/586] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:52.023406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:52.023933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:52.031161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:52.031656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:52.032125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:52.032829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:52.033292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:52.033725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:52.108326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:52.108943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:52.116351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:52.116851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:52.117325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:52.118076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:52.118545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:52.119292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:52.173595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:52.183499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce1f83fc-2a7a-4e5c-b36b-a7af02a7d73c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1713 microversion: 2.1 time: 0.164078 Sep 11 05:33:52.184470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 292/587] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:33:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:33:52.262446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:52.271212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:52.272703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:52.274122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8580f9ec-8869-46c7-be70-c87355ebaf59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.169942 Sep 11 05:33:52.275151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 296/588] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:53.301694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:53.303022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:53.317516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:53.318841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:53.319870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:53.322082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:53.323169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:53.324322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:53.518234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:53.530493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:53.532252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:53.533430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b32300cb-be18-4e23-a95c-2eac17269f91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.236739 Sep 11 05:33:53.544559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 293/589] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:54.558939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:54.559548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:54.567329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:54.568043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:54.568630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:54.569424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:54.569895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:54.570477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:54.746898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:54.757276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:54.759050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:54.762040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c0cf17f-c1b1-4241-a646-cf7b1639222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.205828 Sep 11 05:33:54.762040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 297/590] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:33:55.800951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:55.802286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:55.805054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=74 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:55.811060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:55.811626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:55.812172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:55.812945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:55.813436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:55.813862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:55.958425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:55.961856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:33:55.970285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:55.972136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:55.973573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23767435-b1b8-4b88-8c13-3e89fd4ba612 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.176686 Sep 11 05:33:55.974140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 294/591] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:57.000703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:57.001424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:57.007652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:57.008169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:57.008603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:57.009543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:57.010171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:57.010750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:57.151305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:57.160403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:57.161934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:57.163173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8497a47d-895e-42b6-b2f0-678ef1414d62 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.166812 Sep 11 05:33:57.163808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 298/592] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:58.190436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:58.191073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:58.198239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:58.198727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:58.199163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:58.199861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:58.200343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:58.200807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:58.335604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:58.344091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:58.345547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:58.346679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e25bc259-031d-4856-96c0-b7def37b642a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1739 microversion: 2.20 time: 0.160156 Sep 11 05:33:58.347235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 295/593] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:33:59.371882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:33:59.372543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:33:59.379387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:59.379975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:59.380463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:59.381207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:33:59.381714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:33:59.382140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:33:59.524868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:59.532982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:59.534423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:33:59.535606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3600e0a4-d9cb-4944-a70d-06ed320e4480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1721 microversion: 2.20 time: 0.167593 Sep 11 05:33:59.536289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 299/594] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:33:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:00.561103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:00.561994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:00.567817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:00.568368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:00.568811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:00.569510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:00.569958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:00.570374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:00.707956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:00.717546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:00.719010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:00.720316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90db03a4-4a90-4556-899a-cfa92cbad822 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1721 microversion: 2.20 time: 0.163150 Sep 11 05:34:00.720857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 296/595] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:01.749501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:01.750588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:01.758532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:01.759191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:01.760201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:01.761156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:01.762080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:01.762785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:02.242348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:02.252040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:02.253682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:02.254963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59385b11-14e3-44b4-8e08-5d50bec99c67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1721 microversion: 2.20 time: 0.513458 Sep 11 05:34:02.255524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 300/596] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:03.285128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:03.286402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:03.294091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:03.294591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:03.295034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:03.296280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:03.296746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:03.297170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:03.470526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:03.479596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:03.481520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:03.483709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be118bad-c572-4625-93a4-268c84b65fbf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1721 microversion: 2.20 time: 0.201800 Sep 11 05:34:03.504148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 297/597] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:04.512719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:04.513344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:04.526468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:04.528941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:04.540812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:04.541603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:04.542083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:04.542706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:04.760805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:04.772089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:04.773851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:04.775536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a9e423e-3421-4a50-a09e-0f17c4b1dea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1721 microversion: 2.20 time: 0.268525 Sep 11 05:34:04.776776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 301/598] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:05.002978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "name": "network-vif-unplugged", "status": "completed", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:05.018655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:05.019390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:05.020053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:05.042217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] Creating event network-vif-unplugged:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:34:05.051371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-042da35d-e2b5-4266-8a39-68120040f108 req-9f1213fe-a78b-4fa0-b606-a3a92a0622cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053619 Sep 11 05:34:05.052776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 298/599] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:34:05.804763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:05.806109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:05.812565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:05.813050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:05.813716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:05.814460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:05.814917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:05.815347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.060546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:06.070666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:06.072395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:06.073564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4ed6f3e-8c6a-410d-a5d7-a7c61327c26a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1724 microversion: 2.20 time: 0.275115 Sep 11 05:34:06.074157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 302/600] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:06.099978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e347d3b8-9207-43b5-9cc0-68d3e996e2fe"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:06.102394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:06.108897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.109389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.109824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.110795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.111348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.111787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.454928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e6e211d-8ef7-4b48-9235-7f0c3506da6e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.359995 Sep 11 05:34:06.461926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 299/601] 10.222.0.33 () {62 vars in 1364 bytes} [Sun Sep 11 05:34:06 2022] POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:34:06.659482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:06.660117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:06.677103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.677618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.678073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.678801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.679280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.679730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.745310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120644) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 05:34:06.862058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99d75fa9-cda7-4297-ad2d-5ebd3f24cbea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.207015 Sep 11 05:34:06.862734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 303/602] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 11 05:34:06 2022] POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:34:06.871567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:06.872493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:06.882548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.884890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.885617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:06.886537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:06.887016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:06.891722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:07.195834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:07.205554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:07.211598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:07.217161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da404249-5a72-4d42-bb9b-c279b7d3298c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1750 microversion: 2.20 time: 0.345372 Sep 11 05:34:07.217855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 300/603] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1750 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:08.244299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:08.244886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:08.256184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:08.256955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:08.258465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:08.261718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:08.262392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:08.262996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:08.482124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:08.491210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:08.492732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:08.494200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7b185ab-8df3-4d16-9ee9-afbbd67b9293 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1750 microversion: 2.20 time: 0.254191 Sep 11 05:34:08.495253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 304/604] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:09.527819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:09.528542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:09.536525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:09.537023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:09.537464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:09.538365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:09.538985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:09.539590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:09.843917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:09.864156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:09.866169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:09.867715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1c56db5-cd55-4f4a-a2c3-e6bec5e931da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1750 microversion: 2.20 time: 0.345716 Sep 11 05:34:09.887150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 301/605] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1750 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:10.894964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:10.895570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:10.905629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:10.906513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:10.908275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:10.922098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:10.926174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:10.926895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:11.081745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:11.108226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:11.109540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:11.112223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e5cac61b-1cee-449c-a800-8a40df5c68f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1752 microversion: 2.20 time: 0.221599 Sep 11 05:34:11.124741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 305/606] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:12.141357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:12.148985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:12.156448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:12.157174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:12.157799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:12.158684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:12.159301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:12.159885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:12.353303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:12.363964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:12.365721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:12.366938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-491d5600-5d3a-4819-87fa-5cb7850eb2b9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1752 microversion: 2.20 time: 0.230046 Sep 11 05:34:12.367500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 302/607] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:13.396972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:13.398155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:13.417292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:13.417695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:13.418121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:13.418827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:13.419289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:13.419703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:13.892103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:13.903003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:13.905417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:13.907007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7977f3fd-4ac4-40b4-ba2e-b9882c3f5883 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1752 microversion: 2.20 time: 0.514911 Sep 11 05:34:13.908144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 306/608] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1752 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:14.934040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:14.935340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:14.945894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:14.946653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:14.947264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:14.948195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:14.948834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:14.949421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:15.106135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:15.119467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:15.120922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:15.122309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d3e3870-20f8-4c3d-a5fa-c8cbbb16b089 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.192402 Sep 11 05:34:15.124830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 303/609] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:16.148947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:16.149542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:16.156992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:16.157568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:16.158247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:16.159175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:16.159700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:16.160363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:16.300236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:16.310032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:16.312281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:16.313944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3687cee-e83c-4794-9a1a-bd66bc185ae2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.169054 Sep 11 05:34:16.315033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 307/610] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:17.341840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:17.342758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:17.349462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:17.349948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:17.350394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:17.351293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:17.351531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:17.351964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:17.504091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:17.515519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:17.517148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:17.518646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b48f8498-da11-4544-beb9-9ca5cf091b8b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.181026 Sep 11 05:34:17.528345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 304/611] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:18.544327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:18.545579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:18.554678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:18.558109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:18.558609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:18.559052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:18.559766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:18.560260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:18.560794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:18.734544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:18.745047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:18.746846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:18.748695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e05e34c4-3c8f-4f68-a3bd-763bae178488 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.208397 Sep 11 05:34:18.750036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 308/612] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:19.779050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:19.795503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:19.795503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:19.795503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:19.795503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:19.811551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:19.812329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:19.812973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:20.105622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:20.115314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:20.116983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:20.118401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b47b719e-d2bd-4086-bacb-1a6b8aa7cdda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.347251 Sep 11 05:34:20.119161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 305/613] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:20.705589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e7ef492-cd7f-4378-9cf0-72f162a03a5d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'create', calling method: .version_select at 0x7f2c3f1b59d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-536814004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5YZX+iQFCg6k1E4WQMwbeyPucdGpZ2y12HtqXo3aCOHUx+I1mTtzU6X+QQpR00l+JShN5IEnq4TKRAbKE0oYCAbJ999I0UBbQZ+YAFta+dwTJbZLn1Fs9FRdIDyLAlMQ=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:20.721026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-2e7ef492-cd7f-4378-9cf0-72f162a03a5d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Getting quotas for project da4ccd5b2fa14cd188de7c86f31d8632. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:34:20.724790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-2e7ef492-cd7f-4378-9cf0-72f162a03a5d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Getting quotas for user c9acda7a0d8c4834aace017083393cd0 and project da4ccd5b2fa14cd188de7c86f31d8632. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:34:20.747005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e7ef492-cd7f-4378-9cf0-72f162a03a5d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045237 Sep 11 05:34:20.747588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 309/614] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:34:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:34:20.805871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-627437155", "imageRef": "4472897b-adec-425e-bf4f-28ffd360138b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-536814004", "networks": [{"uuid": "41b4dde0-1bee-49b5-8aec-d23d29ece122"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:20.861809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] validate_networks() for [('41b4dde0-1bee-49b5-8aec-d23d29ece122', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:34:21.150630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:21.151252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:21.158082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:21.158845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:21.159469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:21.160593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:21.161212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:21.161797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:21.167108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:21.271834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:34:21.272416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:34:21.272958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:34:21.273455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:34:21.274024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:34:21.283926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:21.284539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:21.285117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:21.285987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:21.286507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:21.287072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:21.305501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Getting quotas for project da4ccd5b2fa14cd188de7c86f31d8632. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:34:21.306124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:21.309605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Getting quotas for user c9acda7a0d8c4834aace017083393cd0 and project da4ccd5b2fa14cd188de7c86f31d8632. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:34:21.316710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:21.318325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:21.319509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b91af0f-356f-442d-ae5c-c4f473014f67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.172820 Sep 11 05:34:21.320105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 310/615] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:21.322069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:34:21.324344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4472897b-adec-425e-bf4f-28ffd360138b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:34:21.374788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60a3dd88-3c28-47dc-9b8e-ade020af7447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572723 Sep 11 05:34:21.382035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 306/616] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:34:21.387763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9bffec2-0bf7-4496-8d96-60266b245eae tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:21.388411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9bffec2-0bf7-4496-8d96-60266b245eae tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:21.443497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f9bffec2-0bf7-4496-8d96-60266b245eae tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:21.450613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9bffec2-0bf7-4496-8d96-60266b245eae tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1257 microversion: 2.1 time: 0.067050 Sep 11 05:34:21.451216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 311/617] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:22.347243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:22.347856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:22.354861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:22.355346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:22.355800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:22.356515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:22.356970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:22.357527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:22.474103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:22.474838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:22.481663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:22.482151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:22.482684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:22.483397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:22.483849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:22.484494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:22.491593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:22.502593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:22.504059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:22.505231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00fcea46-ee2c-4ce4-b5ed-f83200ff74d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.163129 Sep 11 05:34:22.515587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 307/618] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:22.561490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:22.569267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-848a274b-011f-4f93-95b2-0a138694e3a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.099293 Sep 11 05:34:22.569836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 312/619] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:23.282621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:23.283142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:23.289022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.289510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.289948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.290640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.291096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.291525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.425482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid f21e298e-8d2d-498e-bc3d-ab38260b9914 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:34:23.532325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:23.532992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:23.540063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.540574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.541109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.541842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.542277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.542702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.546783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf08b99c-46be-4b21-946b-05fcc81aa4b2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914/os-volume_attachments/6bc0f9e3-2c7d-43ad-9656-f98703473afe" status: 202 len: 0 microversion: 2.1 time: 0.267788 Sep 11 05:34:23.548659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 308/620] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:34:23 2022] DELETE /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914/os-volume_attachments/6bc0f9e3-2c7d-43ad-9656-f98703473afe => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:34:23.594102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:23.594815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:23.612266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.612266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.612266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.612266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:23.612580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:23.612580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:23.626476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:23.684912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:23.693744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b15a57dd-546e-46b6-991b-837778c9548a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.104384 Sep 11 05:34:23.694515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 309/621] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:23.703731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:23.712511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:23.713955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:23.715135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08f0c12a-5e26-4956-80cf-c81d78f50504 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.188097 Sep 11 05:34:23.715696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 313/622] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:24.717074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:24.717886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:24.725223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:24.725725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:24.726206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:24.727147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:24.727627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:24.728057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:24.741889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:24.743151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:24.750860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:24.764977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:24.765705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:24.766644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:24.767104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:24.767532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:24.797736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:24.806686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b86c2540-9ef9-43ae-83eb-1dcf1655065a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.093411 Sep 11 05:34:24.816238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 310/623] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:24.926712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:24.936385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:24.938870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:24.940281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8436a01-142f-4d9d-baef-bf49c508572e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.202585 Sep 11 05:34:24.951921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 314/624] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:25.830452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:25.831069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:25.833410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:25.838805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:25.839294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:25.839731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:25.840528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:25.840987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:25.841418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:25.903122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:25.912961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc09c719-52f0-4c2f-b17d-b18007fb60b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.086983 Sep 11 05:34:25.914054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 311/625] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:25.965552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:25.967508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:25.974119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:25.974533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:25.974974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:25.975683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:25.976180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:25.976610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:26.119619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:26.129352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:26.131097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:26.132302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6567c3f-a464-4e5b-849a-73298d70209a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.170588 Sep 11 05:34:26.132869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 315/626] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:26.936250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:26.936905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:26.943921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:26.944554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:26.945074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:26.946057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:26.946552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:26.947032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:27.013370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:27.022502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4885c248-6d94-4126-b754-bcf394739c6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.090205 Sep 11 05:34:27.023078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 312/627] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:27.160425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:27.162105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:27.173566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:27.174092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:27.174538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:27.175267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:27.175728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:27.176183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:27.316247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:27.325076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:27.327256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:27.328567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3277785-dbe6-411f-9a57-28ebf40cd243 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.172489 Sep 11 05:34:27.338419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 316/628] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:28.047914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:28.048636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:28.054891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:28.055377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:28.055812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:28.056580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:28.056987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:28.057413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:28.130922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:28.140860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea5308a2-5d98-4746-b498-6ffd8d1edffb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.097405 Sep 11 05:34:28.141432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 313/629] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:28.361982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:28.363254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:28.370126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:28.370617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:28.371055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:28.371760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:28.372269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:28.372696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:28.513514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:28.522898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:28.524396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:28.525574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e158a6f-4cfd-4d5a-9003-e928d766ead6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.174611 Sep 11 05:34:28.536081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 317/630] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:29.164188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:29.164913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:29.171961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:29.172480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:29.172921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:29.173625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:29.174257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:29.174883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:29.237869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:29.245607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5edc97d9-fd24-4def-b00f-34a746799523 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.085454 Sep 11 05:34:29.246171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 314/631] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:29.551460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:29.552297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:29.559020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:29.559506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:29.559944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:29.560755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:29.561213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:29.561633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:29.700174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:29.709598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:29.711047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:29.712264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c533e793-fc69-4c37-ad5c-e0b6ed7852e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.164826 Sep 11 05:34:29.721346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 318/632] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:30.270416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:30.271780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:30.278615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:30.279470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:30.280236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:30.281062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:30.281520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:30.281973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:30.344263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:30.351938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fab5893-f88e-41cd-b3ab-bf4cdc8acf54 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.085764 Sep 11 05:34:30.352522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 315/633] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:30.739399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:30.740032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:30.745895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:30.746373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:30.746811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:30.747497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:30.748117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:30.748549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:30.882760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:30.893290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:30.894757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:30.895920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a3a53e3-18e9-4ba7-9ea5-d2d63a0a19d0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.160654 Sep 11 05:34:30.896583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 319/634] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:31.375805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:31.376467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:31.378742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:31.379398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:31.385247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:31.385732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:31.386170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:31.386860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:31.387315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:31.387737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:31.447565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:31.455257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c4c0b4c-d1e4-4de9-a457-9783c37c0210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.083894 Sep 11 05:34:31.455814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 316/635] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:31.921220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:31.921757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:31.923604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:31.929383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:31.929858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:31.930291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:31.930973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:31.931421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:31.931836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:32.065542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:32.073884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:32.075362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:32.077005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-526ce69a-54da-442f-8368-ff3c86c8d4a6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.160690 Sep 11 05:34:32.077555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 320/636] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:32.478650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:32.479264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:32.486316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:32.486798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:32.487234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:32.487925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:32.488423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:32.488848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:32.551060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:32.558687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3299e503-b834-473e-a511-36cb598c1077 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.083982 Sep 11 05:34:32.559236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 317/637] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:33.103123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:33.103776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:33.110140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:33.110645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:33.111079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:33.111762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:33.112239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:33.112656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:33.240631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:33.249511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:33.250950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:33.252148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9842b157-e935-4b4c-889a-75674cb9b749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.152855 Sep 11 05:34:33.252700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 321/638] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:33.581402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:33.582032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:33.588535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:33.589020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:33.589460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:33.590156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:33.590616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:33.591045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:33.650424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:33.658688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f0e527d-2a10-4936-b0c8-001e9335e070 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.081172 Sep 11 05:34:33.659266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 318/639] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:34.282689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:34.283297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:34.289803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:34.290325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:34.290786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:34.291474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:34.291928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:34.292417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:34.425252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:34.433949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:34.435469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:34.436721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b05481f1-7011-4cdd-b129-18d6dc2d6d92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.158467 Sep 11 05:34:34.437284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 322/640] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:34.682061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:34.682601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:34.689883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:34.690364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:34.690798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:34.691490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:34.691938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:34.692382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:34.752995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:34.760918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0663a475-47fd-42fa-a970-bca9376ad7a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.082811 Sep 11 05:34:34.761472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 319/641] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:35.462106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:35.462712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:35.469094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:35.469568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:35.469996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:35.470676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:35.471122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:35.471541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:35.598474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:35.607709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:35.609171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:35.610325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5afc429-0717-4479-bb90-9fa333b6dafa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.152159 Sep 11 05:34:35.610919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 323/642] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:35.783626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:35.784307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:35.790670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:35.791162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:35.791602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:35.792352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:35.792817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:35.793244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:35.853849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:35.862149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f05bd5e0-78db-4fa5-b62e-34b75558f4ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1261 microversion: 2.1 time: 0.082499 Sep 11 05:34:35.862717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 320/643] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:36.636241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:36.636882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:36.644228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:36.644725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:36.645204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:36.645898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:36.646359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:36.646787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:36.775675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:36.784424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:36.785853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:36.787010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a9ec685-1e8e-4d97-b89e-c8a3626341a3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.155071 Sep 11 05:34:36.787559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 324/644] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:36.886512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:36.887149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:36.894457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:36.894943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:36.895381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:36.896112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:36.896575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:36.897006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:36.969338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:36.977619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-766c173f-6752-4b21-bc47-71065079abc1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1309 microversion: 2.1 time: 0.095655 Sep 11 05:34:36.978208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 321/645] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:37.434121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:37.434620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:37.440667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.441151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.442251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.442251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.442721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.443147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.468329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:34:37.545597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67f36b7c-dd82-434a-a7b4-372826be23ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 204 len: 0 microversion: 2.1 time: 0.114369 Sep 11 05:34:37.546174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 325/646] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:34:37 2022] DELETE /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:34:37.554407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:37.555013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:37.562215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.562701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.563132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.564134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.564589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.565007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.707822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:37.715462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb984cfc-49f6-4953-b5ca-734c434698f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.164975 Sep 11 05:34:37.716056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 322/647] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:37 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:37.812942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:37.813673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:37.819919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.820438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.820877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.821573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:37.822031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:37.822462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:37.825096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:37.965172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:37.974593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:37.976043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:37.977208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81c9d34d-9859-4590-bf61-bfeb4719a509 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.168916 Sep 11 05:34:37.977769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 326/648] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:38.000631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:38.001242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:38.007498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:38.007979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:38.008440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:38.009123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:38.009829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:38.010250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:38.070697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:38.078860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da3c4898-81b0-4ed9-a4c3-67f61282313b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1317 microversion: 2.1 time: 0.082446 Sep 11 05:34:38.079428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 323/649] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1317 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:38.739314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:38.739933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:38.745908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:38.746402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:38.746825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:38.747508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:38.748864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:38.749444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:38.875893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:38.883363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0bd058bf-2909-47f9-b369-11fe0cae24a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.147863 Sep 11 05:34:38.883948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 327/650] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:38 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:39.002235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:39.002848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:39.009215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.009960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.010395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:39.011082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.011539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.011964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:39.102431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:39.103072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:39.109786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.110259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.110688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:39.111379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.111833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.112273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:39.144262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:39.152939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:39.155014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:39.156240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3dce330-4027-4463-94ba-acdec540a102 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.157918 Sep 11 05:34:39.156809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 324/651] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:39.176734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:39.184340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c13a7bd9-c598-411a-89ff-38dacc37272f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1317 microversion: 2.1 time: 0.085689 Sep 11 05:34:39.184901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 328/652] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:39.906089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:39.906709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:39.913864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.914581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.915207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:39.916134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:39.916595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:39.917028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:40.082870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:40.092595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85cd9163-698c-400e-9f64-09c7a9f48d67 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.190734 Sep 11 05:34:40.108063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 325/653] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:39 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:40.183570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:40.184307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:40.192848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:40.193343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:40.193936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:40.194819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:40.195352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:40.195852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:40.207009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:40.207710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:40.215541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:40.216050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:40.218106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:40.218829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:40.219294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:40.219724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:40.231598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:40.390550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:40.402139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:40.406295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:40.408018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45841a65-c31d-42bc-b972-ce92626acbca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.228953 Sep 11 05:34:40.409906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 329/654] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:40.867447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:40.881211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71734693-8860-4e4c-b711-9c36b6e7b42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.677916 Sep 11 05:34:40.882340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 326/655] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:41.130291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:41.131023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:41.138144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.139162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.139670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.140501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.141030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.141526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.291590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:41.303323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ec96cd8-1b98-4eb0-9f67-861dadaea55f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.187990 Sep 11 05:34:41.304025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 330/656] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:41 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:41.401596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:41.413334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.414171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.414892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.437500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:41.438592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:41.442828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] Creating event network-changed:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:34:41.445225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.445723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.446167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.447110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.447715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.448209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.449283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fb566f5b-1c4e-4c19-b085-06fa3dd7f3c8 req-ea72de1c-84fa-4741-8f6f-808351fb8036 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053586 Sep 11 05:34:41.449963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 327/657] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:34:41.596177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:41.605094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:41.606536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:41.608312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78b8e8fd-54bc-47fa-b544-4f587d08ebb1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.176417 Sep 11 05:34:41.608881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 331/658] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:34:41.920883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:41.922438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:41.933241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.934072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.934808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:41.937173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:41.937932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:41.938631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.090147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:42.098383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7a42de5-2300-41e0-bdf1-0b3da3bfceb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.183653 Sep 11 05:34:42.099144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 328/659] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:42.327035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:42.327785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:42.334449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:42.334936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:42.335373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.336131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:42.336584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:42.337006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.485576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:42.495475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a02e08d8-3580-4cf2-af9e-58b50b4ecc51 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.172493 Sep 11 05:34:42.496090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 332/660] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:42 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:42.637331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:42.637966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:42.645473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:42.646011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:42.646531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.647279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:42.647736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:42.648216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.795856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:42.805322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:42.807348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:42.808230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b23f22d2-8ed8-4abb-a513-e018f539b314 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.177121 Sep 11 05:34:42.808818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 329/661] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:42.958353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e298e-8d2d-498e-bc3d-ab38260b9914", "name": "network-vif-unplugged", "status": "completed", "tag": "deb2ba1c-e4db-4fc3-be6e-bff8d992c23c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:42.972318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:42.973188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:42.973990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:42.989405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] Creating event network-vif-unplugged:deb2ba1c-e4db-4fc3-be6e-bff8d992c23c for instance f21e298e-8d2d-498e-bc3d-ab38260b9914 on hv-cinder-85692 Sep 11 05:34:42.995369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-15bc958d-35fe-483b-9710-0f1f53d3445d req-2cc8553b-3922-457f-9142-6d444fc720a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042979 Sep 11 05:34:43.001844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 333/662] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:34:43.122022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:43.122687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:43.129461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.129961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.130405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.131122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.131778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.132392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.273539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:43.282486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ce41925-48a0-442a-bb72-cc93cd494539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.164335 Sep 11 05:34:43.283254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 330/663] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:43.523232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:43.524298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:43.531446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.531936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.532409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.533117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.533575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.534030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.681447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:43.690557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02252e35-55f5-4e80-9bb8-86b017fcc12b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.173331 Sep 11 05:34:43.691238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 334/664] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:43 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:43.834829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:43.835439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:43.842450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.843197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.843641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.844368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:43.844990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:43.845417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:43.994863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:44.008053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:44.010536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:44.012141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15247a34-d175-42ae-83bd-acb6c2df6f3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.181045 Sep 11 05:34:44.012913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 331/665] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:44.306287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:44.306928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:44.314266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:44.314759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:44.315200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:44.316093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:44.316559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:44.316989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:44.457818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:44.468264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2290bdf4-701d-417b-92d5-26f829ab23a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.165362 Sep 11 05:34:44.469204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 335/666] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:44.715097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:44.715713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:44.723128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:44.723621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:44.724083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:44.724796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:44.725252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:44.725677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:44.876894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:44.897339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95cac105-f51a-474e-b002-04632422d54d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.186165 Sep 11 05:34:44.906136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 332/667] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:44 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:45.039414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:45.040095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:45.046458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.046945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.047384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:45.048119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.048578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.049005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:45.191515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:45.200533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:45.202955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:45.204163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae85525e-9e19-416a-9f6c-e4f020e04b3c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.169165 Sep 11 05:34:45.204731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 336/668] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:45.491832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:45.492419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:45.499462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.499955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.500440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:45.501158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.501619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.502046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:45.640908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:45.651575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64ee5338-9d74-40a2-942f-fec82e788370 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.163723 Sep 11 05:34:45.652191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 333/669] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:45.923037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:45.923641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:45.929764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.930243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.930678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:45.931379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:45.931852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:45.932295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:46.078825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:46.087005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-378ae9a3-3aff-4888-8ada-7942ce018252 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.168040 Sep 11 05:34:46.087775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 337/670] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:45 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:46.229461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:46.230115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:46.237622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:46.238116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:46.238551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:46.239258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:46.239711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:46.240160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:46.389195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:46.398389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:46.399834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:46.401050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c6f67ea-3073-4ae1-8d80-6729c64a9865 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.175525 Sep 11 05:34:46.401806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 334/671] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:46.674759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:46.676449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:46.682895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:46.683799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:46.684355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:46.685333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:46.685909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:46.686407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:46.839492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:46.849474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23c0e726-a7ed-42e7-94f0-0b48de7f6cd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.178526 Sep 11 05:34:46.850312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 338/672] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:47.110969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:47.111682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:47.118420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.119008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.119533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:47.120392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.120947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.121463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:47.262317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:47.270911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edd2aa3d-991a-4f75-9d55-f5431e04adc4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.164569 Sep 11 05:34:47.271498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 335/673] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:47 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:47.428318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:47.429575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:47.438224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.438879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.439453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:47.440288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.441088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.441822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:47.592606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:47.602849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:47.604674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:47.605857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8eb862ef-5729-4037-8372-3554f3d48591 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.181519 Sep 11 05:34:47.606418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 339/674] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:47.877311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:47.877925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:47.884006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.884522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.885233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:47.885948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:47.886410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:47.886843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:48.043989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:48.053594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb6c1e3e-dcac-4707-9d65-cbb313a68f07 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.180487 Sep 11 05:34:48.054324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 336/675] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:47 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:48.295751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:48.296385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:48.302466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:48.302963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:48.303411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:48.304168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:48.304614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:48.305050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:48.456495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:48.465143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-06efa4a9-4a88-4f8c-890f-e7cd25ee9097 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.173733 Sep 11 05:34:48.465736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 340/676] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:48 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:48.636434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:48.637063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:48.639514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:34:48.639665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe (ip 10.222.0.33) !!! Sep 11 05:34:48.649589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:48.650423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:48.650897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:48.651615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:48.652097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:48.652523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:48.832369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:48.842523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:48.844217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:48.846053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88c24860-8c96-4a42-9cf1-359f938d65e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.215512 Sep 11 05:34:48.847024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 337/677] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:49.077974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:49.078606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:49.080604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:49.086642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.087322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.087763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:49.088494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.088952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.089380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:49.234783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:49.242489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9c35c77-9a08-45a7-906d-50f0256625b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.168921 Sep 11 05:34:49.243077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 341/678] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:49.493273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:49.493802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:49.500296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.500784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.501218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:49.501911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.502366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.502794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:49.637978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:49.646375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-471b3286-6888-4f28-a19d-f807e3c34a8e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.158628 Sep 11 05:34:49.646941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 338/679] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:49 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:49.871742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:49.873041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:49.879504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.879989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.880458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:49.881157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:49.881615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:49.882041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:50.015926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:50.024524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:50.025956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:50.027122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b619570a-29c1-4672-8c8a-c5d260f5f3d4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.159281 Sep 11 05:34:50.027682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 342/680] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:50.268168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:50.269037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:50.275901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:50.276439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:50.276869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:50.277555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:50.278054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:50.278508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:50.411063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:50.418920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2307f765-cb1b-4d92-a4e0-514a43b87590 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.155651 Sep 11 05:34:50.419565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 339/681] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:50.671455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:50.672054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:50.677926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:50.678401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:50.678833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:50.679514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:50.679963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:50.680424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:50.696806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:50.869345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:50.879416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8be79062-0cee-4ee0-991f-0c2c70419883 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.212581 Sep 11 05:34:50.880089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 343/682] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:50 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:51.055346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:51.055860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:51.062653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.063136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.063566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:51.064298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.064750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.065173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:51.197274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:51.206358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:51.207793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:51.209041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79aecdb8-e2eb-4426-bfb7-62f7574ac29c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.158017 Sep 11 05:34:51.209624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 340/683] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:51.443115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:51.443753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:51.454183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.454670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.455101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:51.455794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.456283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.456703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:51.598144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:51.605737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b8c11fe-420e-4607-851d-4fd46b7166cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.167161 Sep 11 05:34:51.606296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 344/684] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:51 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:51.902881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:51.903544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:51.910167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.910673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.911118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:51.911830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:51.912340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:51.912773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:52.052847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:52.061832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4806f621-ae1e-4a21-91b7-d13431f606d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.162781 Sep 11 05:34:52.062415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 341/685] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:51 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:34:52.235283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:52.235899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:52.242192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:52.242669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:52.243104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:52.243798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:52.244276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:52.244697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:52.377677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:52.386417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:52.388037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:52.389328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-189440cf-a00e-4450-b24a-f4b9b963dd80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.159225 Sep 11 05:34:52.389961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 345/686] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:52.629006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:52.629585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:52.635767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:52.636294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:52.636731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:52.637458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:52.638048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:52.638527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:52.763710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:52.771413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e2f9e66-04f1-40e3-b43f-2170135c4f6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.146328 Sep 11 05:34:52.771980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 342/687] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:52 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:53.085227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:53.085836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:53.092521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.093004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.093438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.094134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.094586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.095008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.228479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:53.236514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e914fa7-6bb8-435b-8275-4d393028429d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1514 microversion: 2.1 time: 0.155203 Sep 11 05:34:53.237118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 346/688] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:53 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:53.414657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:53.415266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:53.421929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.422694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.423203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.423982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.424699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.425281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.447388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:53.490580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e298e-8d2d-498e-bc3d-ab38260b9914", "name": "network-vif-deleted", "tag": "deb2ba1c-e4db-4fc3-be6e-bff8d992c23c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:34:53.501076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.501550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.501976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.514243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] Creating event network-vif-deleted:deb2ba1c-e4db-4fc3-be6e-bff8d992c23c for instance f21e298e-8d2d-498e-bc3d-ab38260b9914 on hv-cinder-85692 Sep 11 05:34:53.519556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-47fd7e14-01e0-41a6-a6df-4069fbb5400a req-71fe695c-22a4-416c-9cfa-176cbaf56088 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Sep 11 05:34:53.521420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 347/689] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:34:53.622899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:53.631641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:53.633049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:53.634195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a112e320-23e4-4479-bec5-8ddf5f88b1f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.223484 Sep 11 05:34:53.635075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 343/690] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:53.796867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:53.797529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:53.805791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.806336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.806784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.807697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:53.807954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:53.808410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:53.961184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:53.969284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31821b3b-9819-43a6-8077-7836e0f85503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.178253 Sep 11 05:34:53.969843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 348/691] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:54.260269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:54.260800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:54.267367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:54.267846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:54.268301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:54.268987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:54.269439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:54.269859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:54.330064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:54.337755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06d2ab5f-2b59-46e5-b824-753c4972d41f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1472 microversion: 2.1 time: 0.081741 Sep 11 05:34:54.338303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 344/692] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:54 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:54.660480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:54.661238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:54.667604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:54.668120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:54.668560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:54.669442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:54.670077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:54.670509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:54.804197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:54.814923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:54.816393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:54.817609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-806be181-4460-4778-9511-23d2e14cffdd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.161120 Sep 11 05:34:54.818167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 349/693] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:54.993666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:54.994286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:55.001873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.002355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.003490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:55.003490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.003926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.004524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:55.144843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:55.152449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-688718bd-2555-4046-925b-c3cc0c5de931 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.163316 Sep 11 05:34:55.153016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 345/694] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:55.362244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:55.362854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:55.371632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.372175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.373200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:55.373898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.374366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.374798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:55.458101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:55.468901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7ed2c2c-62f5-4cb4-8cb1-76fa89fccbaa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 200 len: 1304 microversion: 2.1 time: 0.110381 Sep 11 05:34:55.469598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 350/695] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:55 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:55.844178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:55.844861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:55.848160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=71 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:34:55.852103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.852683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.853189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:55.853963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:55.854489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:55.854988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:56.023081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:56.031879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:56.033353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:56.034528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f3b375d-0011-4a6e-ae11-d9ea54caba9e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.195862 Sep 11 05:34:56.035107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 346/696] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:56.178321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:56.178844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:56.185824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:56.186300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:56.186744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:56.187438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:56.187893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:56.188344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:56.336112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:56.347692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5d044d1f-f8cd-4451-a938-1237985dd062 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.172824 Sep 11 05:34:56.348630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 351/697] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:56.493703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:56.494326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: f21e298e-8d2d-498e-bc3d-ab38260b9914] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:56.501144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:56.501631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:56.502063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:56.502959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:56.503417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:56.503843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:56.518778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] HTTP exception thrown: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Request method failure captured: Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 HTTP/1.1 Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXMCGuMiofl0TAMkpohNl8SPrHe9pwOzUchyTOpdNP1mSjvMnLPIUj4yJTRGa7GUIE2Da0nCDoLnpFW10kUeSN2nzmvfMY3N_BY1zjvLfYvL2i8v5JCDN-ABmAPyicd3Lo26ZkwUuWqgcq74c7GA3ruM9LcDntTMt1QCYZri1S52NJc Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:34:56.520458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbab28318bf84c88b2f3a774defb870f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}] Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 9793a6256764417eb3ff1a8386368801 Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. Sep 11 05:34:56.522022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'f21e298e-8d2d-498e-bc3d-ab38260b9914'} Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:34:56.522788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. Sep 11 05:34:56.524042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:34:56.525224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Returning 404 to user: Instance f21e298e-8d2d-498e-bc3d-ab38260b9914 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:34:56.525224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fac0a3dc-fd35-49b0-bed0-cb9d715b8116 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914" status: 404 len: 111 microversion: 2.1 time: 0.032142 Sep 11 05:34:56.525224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 347/698] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:56 2022] GET /compute/v2.1/servers/f21e298e-8d2d-498e-bc3d-ab38260b9914 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 05:34:57.060712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:57.061262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:57.067206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:57.067688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:57.068189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:57.068984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:57.069479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:57.069909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:57.201264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:57.209895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:57.211308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:57.212483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28e402f3-ad62-41c0-b320-44e2b0f10a83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.156410 Sep 11 05:34:57.213037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 352/699] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:57.371850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:57.373248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:57.379686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:57.380210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:57.380658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:57.381352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:57.381813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:57.382244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:57.514961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:57.522817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee775180-89ca-422b-969a-8f6b45881e21 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.154846 Sep 11 05:34:57.523382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 348/700] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:57 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:58.237370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:58.237982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:58.244528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:58.245007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:58.245442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:58.246128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:58.246584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:58.247005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:58.377903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:58.386670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:58.388880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:58.390049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb27c882-65aa-4647-bada-311fe9355a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.156547 Sep 11 05:34:58.390610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 353/701] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:58.545729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:58.546268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:58.552636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:58.553118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:58.553555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:58.554246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:58.554704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:58.555131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:58.683198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:58.691303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfcc052f-4d85-4ada-8a8a-839a6893e63e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.149645 Sep 11 05:34:58.691859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 349/702] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:58 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:34:59.415076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:59.415675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:59.422676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:59.423155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:59.423594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:59.424310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:59.424764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:59.425188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:59.551589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:59.560509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:59.561952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:59.563112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c568c742-8d8f-49cf-ab07-9f8961f0de88 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.152002 Sep 11 05:34:59.563681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 354/703] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:34:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:34:59.714777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:34:59.715322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:34:59.722477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:59.722968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:59.723405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:59.724170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:34:59.724629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:34:59.725059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:34:59.855658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:34:59.863233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b98e4731-b28b-4290-b4d6-efddecd3489c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.152472 Sep 11 05:34:59.863787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 350/704] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:34:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:00.588493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:00.589129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:00.595572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:00.596081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:00.596525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:00.597234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:00.597715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:00.598142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:00.731327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:00.740019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:00.741460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:00.742617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6987d36f-76a6-4f0c-8d3b-3849ed4c6fa9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.158287 Sep 11 05:35:00.743177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 355/705] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:00.886467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:00.887079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:00.894328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:00.894808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:00.895240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:00.895924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:00.896401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:00.896826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:01.023591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:01.031155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-793f59ed-c2f5-4e34-a609-ef8575c7ecba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.148740 Sep 11 05:35:01.031719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 351/706] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:01.770455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:01.771066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:01.777434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:01.777912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:01.778955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:01.780395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:01.780853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:01.781274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:02.023981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:02.034908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:02.036389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:02.037551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-361102be-66dd-4b9a-914d-e5d4bb62b159 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.271013 Sep 11 05:35:02.038383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 356/707] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:02.060142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:02.060767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:02.067161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:02.067660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:02.068177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:02.068897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:02.069417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:02.069849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:02.202807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:02.210533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29e7e590-7e13-45c0-8373-c9a9367ea529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.154680 Sep 11 05:35:02.211100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 352/708] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:03.066464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:03.067062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:03.073451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:03.073927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:03.074356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:03.075245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:03.075530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:03.075944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:03.210247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:03.220062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:03.221496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:03.222692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d69d5844-4090-4275-9a68-b44b9ff5ec4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.160085 Sep 11 05:35:03.223255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 357/709] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:35:03.234184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:03.234937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:03.241212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:03.241770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:03.242420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:03.243214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:03.243748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:03.244274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:03.384343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:03.392750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceab396e-ce00-45e7-b495-ec2b2989df48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.163098 Sep 11 05:35:03.393390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 353/710] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:03.598728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "name": "network-vif-plugged", "status": "completed", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:03.610301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:03.610814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:03.611292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:03.622500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] Creating event network-vif-plugged:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:35:03.627495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b787085a-1afa-44d8-9481-34cb1d42d724 req-aae376cd-7a8a-4bca-a6eb-2fd58bbbc0b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032363 Sep 11 05:35:03.628104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 358/711] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:04.249091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:04.249664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:04.255807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:04.256323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:04.256755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:04.257445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:04.257898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:04.258328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:04.391795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:04.400906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:04.402338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:04.404369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98071d28-db87-4816-927f-0b371f04c8f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.159935 Sep 11 05:35:04.404935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 354/712] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:04.417195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:04.417906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:04.424644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:04.425135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:04.425578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:04.426282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:04.426741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:04.427172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:04.561778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:04.569437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b69d6275-a78f-4357-b48a-f6330fc8df55 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.156989 Sep 11 05:35:04.570012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 359/713] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:05.430080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:05.430696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:05.437781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:05.438264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:05.438879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:05.439700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:05.440283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:05.440801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:05.577284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:05.586369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:05.589327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:05.590516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-509345fa-59f3-41c6-a9e8-b52453f8a82c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.164384 Sep 11 05:35:05.593003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:05.593865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:05.599987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:05.600511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:05.601126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:05.601824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:05.602704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:05.603135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:05.605386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 355/714] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:05.735111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:05.742628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d586ea84-32ea-4172-ac9b-c9d7c1af2539 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.153877 Sep 11 05:35:05.743190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 360/715] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:06.618141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:06.618748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:06.625972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:06.626455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:06.626906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:06.627579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:06.628047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:06.628472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:06.757164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:06.765769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:06.766473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:06.767959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:06.769449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:06.770624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc77b3fa-c023-4c1b-a44c-e2244801b5c3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.156464 Sep 11 05:35:06.771185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 356/716] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:06.773169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:06.773656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:06.774099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:06.774802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:06.775261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:06.775698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:06.791574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:06.908221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:06.915724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d372345-4f30-4251-adb3-060d7b3031ec tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.154249 Sep 11 05:35:06.916325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 361/717] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:07.797091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:07.797637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:07.804216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:07.804689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:07.805125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:07.805828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:07.806558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:07.806698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:07.938818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:07.942157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:07.943132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:07.947568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:07.949020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:07.950045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:07.950214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a5cc535-83b6-4527-b912-64e5d8eb3cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.157704 Sep 11 05:35:07.950717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:07.951135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 357/718] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:07.951295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:07.952143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:07.952601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:07.953026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:08.079363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:08.087038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a904515-0d30-41e2-8d19-21c78bfe4179 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.150902 Sep 11 05:35:08.087598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 362/719] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:08.543884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1259429740", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "networks": [{"uuid": "89cc4ffd-df0e-4874-a0ee-9ef72dc5018f"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:08.597877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] validate_networks() for [('89cc4ffd-df0e-4874-a0ee-9ef72dc5018f', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:35:08.978409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:08.979346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:08.987459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:08.988204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:08.988734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:08.989764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:08.990391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:08.994152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:35:08.994739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:35:08.995048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:35:08.995798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:35:08.996247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:35:08.999887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:09.013071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:09.013883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:09.014786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:09.015751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:09.016445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:09.017116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:09.035891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Getting quotas for project bbab28318bf84c88b2f3a774defb870f. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:35:09.039980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Getting quotas for user 9793a6256764417eb3ff1a8386368801 and project bbab28318bf84c88b2f3a774defb870f. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:35:09.052141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:35:09.054479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:35:09.105436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c34f8fa8-419c-4b01-961a-ba3944240d35 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563924 Sep 11 05:35:09.106281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 358/720] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:35:09.111178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:09.111802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:09.119014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:09.119514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:09.119959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:09.122287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:09.122800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:09.123599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:09.156745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:09.166763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:09.168239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:09.169418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3dced9f8-50ea-402b-8e7e-6c81c412ccae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.198663 Sep 11 05:35:09.185234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 363/721] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:35:09.194334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20c84114-0585-42db-b77a-2ef4eef4570c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:09.195360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20c84114-0585-42db-b77a-2ef4eef4570c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:09.269287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-20c84114-0585-42db-b77a-2ef4eef4570c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:09.278375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20c84114-0585-42db-b77a-2ef4eef4570c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1219 microversion: 2.1 time: 0.091511 Sep 11 05:35:09.279159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 364/722] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:09.308997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:09.317243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46f43dcd-544d-4bef-a149-3a7b8b165976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.210080 Sep 11 05:35:09.317805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 359/723] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:10.198961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:10.199572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:10.207478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.207956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.208421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.209176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.209624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.210064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.266788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "name": "network-vif-plugged", "status": "completed", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:10.279581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.280219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.280660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.292562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] Creating event network-vif-plugged:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:35:10.300760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fa96cac0-87af-4c81-bda5-94eb6e9f512a req-c8b6cb16-e407-4dfb-a550-9736527efc20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038142 Sep 11 05:35:10.301539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 360/724] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:35:10.307405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:10.308383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:10.315030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.315519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.316228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.316936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.317553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.318147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.351705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:10.360988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:10.362540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:10.363792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5a08f39-5f4c-4075-a065-688cde23f76f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.168819 Sep 11 05:35:10.364463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 365/725] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:10.369252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:10.369863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:10.376209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.376696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.377180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.377913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:10.378363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:10.378792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:10.389405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:10.397037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0baca1da-2152-46d6-8b6c-143b5e177332 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1223 microversion: 2.1 time: 0.093982 Sep 11 05:35:10.397601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 361/726] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:10.513340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:10.523750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-14f77ddb-9623-4174-859d-a4e62ef7f27e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.158053 Sep 11 05:35:10.524807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 366/727] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:11.390628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:11.391383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:11.399935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.400681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.401905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.404396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.405065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.405373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.409947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:11.420597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:11.421217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:11.427611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.428126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.428568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.429262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.429719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.430141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.495837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:11.504074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf3cc0d1-8be9-420e-aeee-6effa135401a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1215 microversion: 2.1 time: 0.087759 Sep 11 05:35:11.504871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 367/728] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:11 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:11.549888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:11.550538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:11.556835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.557401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.557846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.558547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:11.559006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:11.560234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:11.587572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:11.598904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:11.600536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:11.601870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d6d9fb6-17b1-4ee8-b54c-2ef96ac00f65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.215271 Sep 11 05:35:11.602516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 362/729] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:11.686663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:11.694204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-615d8bda-6517-40aa-89d9-e07510f7bd02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.148252 Sep 11 05:35:11.694773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 368/730] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:12.527572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:12.528890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:12.537326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.537326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.537994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.538444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.538910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.539343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.602219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:12.611550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1ab55e5-d552-40e8-bffd-5138234c474b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1215 microversion: 2.1 time: 0.087749 Sep 11 05:35:12.612158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 363/731] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:12.630712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:12.631439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:12.638683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.639174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.639619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.640350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.640808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.641237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.720398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:12.721022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:12.727396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.727795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.728443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.729366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:12.730016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:12.730647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:12.784424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:12.797257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:12.798703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:12.800658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2a22eaf-26b0-4ba1-a471-2bd77f6b1b47 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1808 microversion: 2.20 time: 0.173776 Sep 11 05:35:12.801634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 369/732] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:12.882623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:12.892403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79b38991-c8f4-469b-b8fe-908eaa45b22e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.176579 Sep 11 05:35:12.893038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 364/733] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:13.634137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:13.635033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:13.641931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.642408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.642841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.643529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.644067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.644642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.708244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:13.716782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-612f3095-2fe4-45a1-a7b5-f45ff7f1332a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1271 microversion: 2.1 time: 0.086514 Sep 11 05:35:13.717343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 370/734] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:13.827746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:13.828395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:13.835051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.835532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.836016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.836729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.837177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.837599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.917038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:13.917611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:13.928938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.929754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.930198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.931087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:13.931547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:13.931980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:13.979216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:13.988244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:13.989875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:13.991096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-046efa09-8bba-408f-9d4c-961d14313dcb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1795 microversion: 2.20 time: 0.168305 Sep 11 05:35:13.991658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 365/735] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:35:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1795 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:35:14.066024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:14.073535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-279041a2-de39-47d8-9363-cded4493d447 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1357 microversion: 2.1 time: 0.160653 Sep 11 05:35:14.074110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 371/736] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:14.739573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:14.740228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:14.746107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:14.746650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:14.747628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:14.748348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:14.748805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:14.749235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:14.816581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:14.825851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0aa57ddc-03b9-49c4-8aa7-489f8830789f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1271 microversion: 2.1 time: 0.089860 Sep 11 05:35:14.826416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 366/737] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:15.097333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:15.097875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:15.104254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.104737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.105174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.105861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.107058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.107486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.238910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:15.246716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78d0383d-1dd4-4528-81a3-c88aa5777666 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1546 microversion: 2.1 time: 0.153271 Sep 11 05:35:15.247401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 372/738] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:15.271704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:15.272607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:15.279537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.280050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.280492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.281225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.281680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.282099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.461880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:15.470214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64f4a45a-84c5-425d-b7e3-6a8cb94f51ef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1546 microversion: 2.1 time: 0.204123 Sep 11 05:35:15.470875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 367/739] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:15.494360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:15.500445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:15.501433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Searching by: {'deleted': False, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632'} {{(pid=120644) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 05:35:15.508308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.508792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.509231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.510223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.510684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.511121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.609285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.multi_cell_list [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120644) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 05:35:15.711081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1b35943-f327-4d70-8feb-bbb3f36f6a4f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.220460 Sep 11 05:35:15.711672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 373/740] 10.222.0.33 () {58 vars in 1125 bytes} [Sun Sep 11 05:35:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:15.723744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:15.724393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:15.730489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.731037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.731712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.732460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.732924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.733363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.849155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:15.849762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:15.855785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.856354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.857119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.857871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:15.858325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:15.858747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:15.922703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:15.925267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:15.931496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9446305-5acd-4b27-b6c6-74a472f400c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1546 microversion: 2.1 time: 0.211410 Sep 11 05:35:15.932214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 368/741] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:15.934718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51c262c1-e874-4759-88aa-680579beee92 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1277 microversion: 2.1 time: 0.089369 Sep 11 05:35:15.935465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 374/742] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:16.957525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:16.958277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:16.964628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:16.965106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:16.965779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:16.966726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:16.967182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:16.967606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:17.154964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811bc271-657e-410b-9fb8-dfc4c0ca1880", "tag": "e8803d5d-3a7a-4ad5-9375-30807fb3f871"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:17.164900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:17.165375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:17.165797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:17.177234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] Creating event network-changed:e8803d5d-3a7a-4ad5-9375-30807fb3f871 for instance 811bc271-657e-410b-9fb8-dfc4c0ca1880 on hv-cinder-85692 Sep 11 05:35:17.182981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-604fdf9d-a970-4f82-a828-ea6c4de9e14f req-0c61a7cf-c739-4321-aff5-7c8dd780e00a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094170 Sep 11 05:35:17.183664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 375/743] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:35:17.184512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:17.192604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38163556-4d07-4d80-a47c-e159503f3597 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.238935 Sep 11 05:35:17.193252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 369/744] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:17.521502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5470d0e4-70e1-40c0-b38d-9b9becf69c4a"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:17.524017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:17.530949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:17.531433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:17.531860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:17.532577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:17.533028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:17.533446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:18.216870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:18.217626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:18.224838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:18.225399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:18.225982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:18.226768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:18.227348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:18.227782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:18.360197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:18.367851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23a9f47e-89b6-4acd-a360-83d5df2f373b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.155649 Sep 11 05:35:18.368439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 370/745] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:19.203316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:19.204088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:19.275429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:19.310243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd40bdf-d453-432e-920a-0c5563013589"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:19.312819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:19.318770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:19.319264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:19.319737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:19.320469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:19.320933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:19.321365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:21.240611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16d9b249-b2fb-4d60-a55a-b38ba0ab7158 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.723597 Sep 11 05:35:21.241552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 376/746] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:35:17 2022] POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 194 bytes in 3725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:21.243666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b8c8b79-2a79-4125-ba44-d62b91acac58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.044515 Sep 11 05:35:21.244403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 371/747] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:35:19 2022] POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 194 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:35:21.247119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:21.248440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:21.267443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=74 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:21.272738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:21.273461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:21.273901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:21.274610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:21.275557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:21.275984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:21.431170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:21.439592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a3c975a-697b-46ba-934d-f94e34898341 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.196605 Sep 11 05:35:21.452025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 377/748] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:22.463300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:22.464163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:22.471468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:22.471959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:22.472422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:22.473117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:22.473577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:22.474034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:22.607464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:22.615083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b7330df-4db5-4b18-931f-c319dc8f2563 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.156097 Sep 11 05:35:22.615679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 372/749] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:23.638304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:23.638916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:23.645384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:23.645803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:23.646238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:23.646929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:23.647382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:23.647802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:23.650342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:23.776817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:23.784395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5ccf126-c333-4de3-876f-1b5c57ba9271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.150473 Sep 11 05:35:23.784963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 378/750] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:24.638928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811bc271-657e-410b-9fb8-dfc4c0ca1880", "name": "network-vif-plugged", "status": "completed", "tag": "e8803d5d-3a7a-4ad5-9375-30807fb3f871"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:24.650479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:24.651155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:24.651609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:24.662768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] Creating event network-vif-plugged:e8803d5d-3a7a-4ad5-9375-30807fb3f871 for instance 811bc271-657e-410b-9fb8-dfc4c0ca1880 on hv-cinder-85692 Sep 11 05:35:24.667951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-56f4d286-2538-485d-b2a2-86f671a1cda8 req-fb44d990-a8e5-4217-b39c-defb47bc6704 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Sep 11 05:35:24.669155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 373/751] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:24.807951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:24.808705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:24.817893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:24.818393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:24.818835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:24.819554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:24.820042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:24.820467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:24.958671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:24.966799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b91d3465-7c14-4aae-b7c5-6c9284d2daa1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.163777 Sep 11 05:35:24.967468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 379/752] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:24 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:25.990270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:25.990968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:25.993483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:26.000461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:26.000947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:26.001386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:26.002117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:26.002570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:26.002995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:26.134807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:26.143176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-451538c2-7f98-4a19-a007-e4a8e4b8f96d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.157150 Sep 11 05:35:26.143739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 374/753] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:27.166342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:27.166965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:27.169479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:27.175044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:27.175528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:27.175971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:27.176690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:27.177153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:27.177580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:27.306877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:27.314634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b34a8f31-4900-4c8a-997c-2f6145096918 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.152112 Sep 11 05:35:27.315194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 380/754] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:28.337663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:28.338342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:28.345518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:28.346007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:28.346448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:28.347145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:28.347600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:28.348052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:28.477622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:28.485479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d4e95d5-101d-49c6-9c8a-759b1a5a1388 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1319 microversion: 2.1 time: 0.151701 Sep 11 05:35:28.486038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 375/755] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:29.508415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:29.509023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:29.516434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:29.516917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:29.517354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:29.518044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:29.518494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:29.518916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:29.645357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:29.653164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41b8d84a-3e30-4768-8c5b-63763b485d17 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1507 microversion: 2.1 time: 0.148546 Sep 11 05:35:29.653731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 381/756] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:29.675793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7a3a010-d9bf-430f-a952-d31b37daff59", "device": "/dev/sdb"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:29.678681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:29.685660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:29.686144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:29.686587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:29.687283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:29.687743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:29.688217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:29.976312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:29.988006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0cdea5a-1d19-46af-b2b1-5a162d48ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "POST /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315983 Sep 11 05:35:29.988645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 376/757] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:35:29 2022] POST /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:30.942850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:30.945208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:30.951934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:30.952452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:30.952921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:30.953606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:30.954062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:30.954481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:30.977569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'flavor' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:35:31.103867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4500e3a1-3aea-4615-8d79-2eb24017c582 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action" status: 200 len: 32 microversion: 2.1 time: 0.164824 Sep 11 05:35:31.104796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 382/758] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:35:30 2022] POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 05:35:31.115132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:31.115857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:31.123311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:31.123817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:31.124475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:31.125039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:31.125500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:31.125967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:31.339406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:31.348478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fadb965-fd6f-40c3-8e51-4799ebc7375a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.237727 Sep 11 05:35:31.348981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 377/759] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:32.372224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:32.372931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:32.379613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:32.380137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:32.380580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:32.381282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:32.381741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:32.382173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:32.513876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:32.522142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c770ea29-f1c4-4d4a-923f-6049473e9643 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154179 Sep 11 05:35:32.522715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 383/760] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:33.546250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:33.546790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:33.553255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:33.553740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:33.554177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:33.554873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:33.555327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:33.555754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:33.691643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:33.700420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2701349c-4baf-4884-a84a-b90ae5cdeb6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158698 Sep 11 05:35:33.700997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 378/761] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:34.725318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:34.725929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:34.732679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:34.733167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:34.733602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:34.734300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:34.734751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:34.735175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:34.865537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:34.874654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd5b60a5-dab9-4a29-a8dc-e16f0fc18de1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153341 Sep 11 05:35:34.875211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 384/762] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:35.899003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:35.899616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:35.906081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:35.906566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:35.907003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:35.907695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:35.908184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:35.908608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:36.036320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:36.044881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1475534a-1482-4b5e-8238-661512cc5795 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149750 Sep 11 05:35:36.045447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 379/763] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:37.068555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:37.069207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:37.076763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:37.077249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:37.077687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:37.078378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:37.078832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:37.079264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:37.212614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:37.221424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f946be94-4d5a-4412-a3ca-019ee7fb760e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157190 Sep 11 05:35:37.221997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 385/764] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:38.244843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:38.245459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:38.251875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:38.252403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:38.252863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:38.253541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:38.254000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:38.254427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:38.389781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:38.398115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9e24e0a-21c5-4187-b33b-cc240fa36526 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157124 Sep 11 05:35:38.398660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 380/765] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:38.435974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:38.436607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:38.443501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:38.443984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:38.444466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:38.445160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:38.445620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:38.446051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:38.580630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:38.588675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a088b13-2082-4e79-b1c3-e23203624c0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1592 microversion: 2.1 time: 0.156709 Sep 11 05:35:38.589251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 386/766] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:39.422296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:39.422912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:39.429187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:39.429672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:39.430102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:39.430786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:39.431236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:39.431655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:39.573418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:39.582789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea39bae7-7465-48d1-ad05-3717c5215017 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.165134 Sep 11 05:35:39.583585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 381/767] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:40.481557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:40.491911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:40.492424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:40.492975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:40.505481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] Creating event network-changed:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:35:40.510894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-eaee3161-da42-477e-8bcf-cabce0de2df8 req-9be6f34e-5361-4431-8d66-2108490cef42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097808 Sep 11 05:35:40.512311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 387/768] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:40.607623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:40.608562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:40.622080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:40.626753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:40.627210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:40.627955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:40.628525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:40.628960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:40.910881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:40.920151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24526d7f-fb29-408e-8238-c61e2d5a2305 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.317066 Sep 11 05:35:40.920971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 382/769] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:41.586642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-343518781"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:41.587272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:41.594085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:41.594718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:41.595222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:41.596045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:41.596495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:41.596918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:41.724308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.network.security_group_api [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Adding security group 5586fbb7-953c-4c67-a651-7ff244058860 to port d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb Sep 11 05:35:41.944519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:41.945138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:41.951726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:41.952261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:41.952702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:41.953401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:41.953856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:41.954279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:42.081134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4de54f3d-bfd1-4047-a16f-5c35b76c2aca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action" status: 202 len: 0 microversion: 2.1 time: 0.499158 Sep 11 05:35:42.085988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 388/770] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:35:41 2022] POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:35:42.092166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:42.092456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:42.093238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:42.099434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:42.099919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:42.100456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:42.101156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:42.101601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:42.102016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:42.102850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb2a7c09-da30-45dd-bce5-1012ad5b964e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161436 Sep 11 05:35:42.102993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 383/771] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:42.247246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:42.255432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bce58e4c-8f21-48a5-803f-b2ded5d2ab3c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1757 microversion: 2.1 time: 0.168032 Sep 11 05:35:42.256026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 389/772] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:42.527147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:35:42.536470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:42.536955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:42.537391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:42.550098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] Creating event network-changed:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:35:42.555020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-2216b9fe-e27f-4b15-89d0-94d12475a356 req-38c301ff-69f5-4521-ac73-9fe57dc191e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031634 Sep 11 05:35:42.555638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 384/773] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:35:43.126918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:43.127528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:43.134133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:43.134624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:43.135332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:43.136063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:43.137117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:43.137537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:43.275016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:43.284329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c7c5edf-7a34-4f84-b1d7-250e1cc789f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161155 Sep 11 05:35:43.285055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 390/774] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:44.310480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:44.311194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:44.317367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:44.317860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:44.318306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:44.319006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:44.319468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:44.319901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:44.453816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:44.462019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0616650-28c4-4c28-a54d-4b12d492490a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156858 Sep 11 05:35:44.462581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 385/775] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:45.486791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:45.487392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:45.493907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:45.494384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:45.494813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:45.495526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:45.495934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:45.496381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:45.636992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:45.645659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eaeea21a-3115-47aa-bb2a-d47d562ae583 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.163745 Sep 11 05:35:45.646237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 391/776] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:46.669202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:46.669954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:46.676440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:46.676931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:46.677374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:46.678072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:46.678533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:46.678963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:46.813786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:46.822576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3bac703-e50e-439d-b967-425b3b251e0a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157228 Sep 11 05:35:46.823135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 386/777] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:47.846966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:47.847604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:47.854224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:47.854700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:47.855129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:47.855809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:47.856278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:47.856699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:47.985614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:47.994035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64efa03b-3ba5-44c9-bc60-26405ef2d95f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151255 Sep 11 05:35:47.994604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 392/778] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:49.018195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:49.018746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:49.025191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:49.025679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:49.026124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:49.026820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:49.027282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:49.027709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:49.153357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:49.162079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dca6228-ae38-4a69-bed5-45e5cfc200e3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147924 Sep 11 05:35:49.162643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 387/779] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:50.184936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:50.185680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:50.192124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:50.192611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:50.193051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:50.193744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:50.194204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:50.194633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:50.319245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:50.321576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:50.329417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-24ae5768-ecac-4b51-9ae1-2b786c1b148b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148349 Sep 11 05:35:50.329978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 393/780] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:51.352832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:51.353445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:51.359939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:51.360455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:51.360895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:51.361589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:51.362047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:51.362476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:51.495677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:51.504100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1f4597e-37f4-41ca-93d5-72c5089bdcae tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155008 Sep 11 05:35:51.504601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 388/781] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:51.743374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:51.743860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:51.745744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=34 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:51.751562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:51.752063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:51.752502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:51.753196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:51.753654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:51.754148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:51.878427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lazy-loading 'services' on Instance uuid 5eca0a65-6128-4887-b447-6d6e1ddc91a5 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:35:51.994514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d904bb81-d480-45ef-a320-7a069f41b46c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments/a2546382-0373-42bc-9acb-5cd7e1c92058" status: 202 len: 0 microversion: 2.1 time: 0.352293 Sep 11 05:35:51.995105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 394/782] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:35:51 2022] DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments/a2546382-0373-42bc-9acb-5cd7e1c92058 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:35:52.527773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:52.528455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:52.535014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:52.535498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:52.535936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:52.536695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:52.537130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:52.537551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:52.665622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:52.674357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c2fda05-d02b-4777-b9fb-e31d0709288e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150441 Sep 11 05:35:52.674925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 389/783] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:53.699278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:53.699980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:53.706670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:53.707153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:53.707592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:53.708319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:53.708782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:53.709212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:53.841155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:53.849305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3da877cf-decb-4903-ac68-2115e769f168 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154836 Sep 11 05:35:53.849877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 395/784] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:54.872513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:54.873124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:54.879726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:54.880241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:54.880680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:54.881365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:54.881814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:54.882235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:55.008291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:55.017496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9050c5fd-e25a-4206-a02f-42c0f9f2384a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148828 Sep 11 05:35:55.018050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 390/785] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:56.041736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:56.042370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:56.049246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:56.049727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:56.050160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:56.050844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:56.051291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:56.051707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:56.197847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:56.207286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-854d2a8d-37c1-4614-a404-13b4878db72d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.169693 Sep 11 05:35:56.207960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 396/786] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:57.232412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:57.233057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:57.235486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=34 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:35:57.240623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:57.241109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:57.241546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:57.242244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:57.242703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:57.243133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:57.376355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:57.384686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8974a0f1-3f58-4424-bb2e-58d317e58fcb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156153 Sep 11 05:35:57.385520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 391/787] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:35:58.409692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:58.410304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:58.416965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:58.417446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:58.417877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:58.418563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:58.419015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:58.419432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:58.550801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:58.558872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d42e9189-af8f-469a-8de1-e11264e330fc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154243 Sep 11 05:35:58.559445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 397/788] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:35:59.582369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:35:59.582982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:35:59.589411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:59.589892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:59.590328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:59.591019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:35:59.591472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:35:59.591897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:35:59.723227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:35:59.731395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37d9ac0b-1e00-4ed8-9a36-d4b197eca9c4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152867 Sep 11 05:35:59.731961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 392/789] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:35:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:00.755107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:00.755710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:00.762120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:00.762591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:00.763020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:00.763697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:00.764186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:00.764603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:00.894405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:00.902596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eab1af2c-fb18-4f50-8c90-90da02b8ccdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151329 Sep 11 05:36:00.903162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 398/790] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:01.926044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:01.926655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:01.933258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:01.933854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:01.934444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:01.935380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:01.935836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:01.936295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:01.938998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=93 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:02.068242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:02.076484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc04259f-3b59-47c7-8b61-effe4da41f96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154442 Sep 11 05:36:02.077074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 393/791] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:03.100515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:03.101131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:03.107469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:03.107954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:03.108421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:03.109381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:03.109838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:03.110261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:03.239226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:03.247261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa155646-2b98-47c5-9e65-c79f12d075df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150733 Sep 11 05:36:03.247823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 399/792] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:04.271228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:04.271844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:04.278318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:04.278801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:04.279243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:04.279929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:04.280410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:04.281577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:04.409910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:04.422575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45d89405-024d-43c2-a30d-83329f849e40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154827 Sep 11 05:36:04.423587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 394/793] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:05.446732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:05.447338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:05.454270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:05.454748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:05.455186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:05.455874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:05.456363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:05.456839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:05.584985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:05.593620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bad92b13-503c-474c-b976-f643e00bdb24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150213 Sep 11 05:36:05.594341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 400/794] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:06.616760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:06.617410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:06.623819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:06.624869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:06.625311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:06.626007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:06.626470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:06.626900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:06.752991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:06.761466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc024230-3688-4102-8ea9-ecb2757a870d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148653 Sep 11 05:36:06.762029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 395/795] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:07.785198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:07.785740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:07.792141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:07.792626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:07.793061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:07.793753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:07.794206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:07.794632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:07.926133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:07.934335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7ace3fc-50e0-41fb-8614-43e76f8e6f56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153041 Sep 11 05:36:07.934887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 401/796] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:08.959759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:08.960403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:08.966793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:08.967300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:08.967736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:08.968829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:08.969299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:08.969725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:09.101672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:09.110133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0df5faaa-a2bf-4054-a951-679da0452a8a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154152 Sep 11 05:36:09.110690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 396/797] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:10.134579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:10.135480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:10.142428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:10.142913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:10.143362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:10.144083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:10.144547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:10.144977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:10.275468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:10.284196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3fd3e7e-f35c-4ce9-9522-6c03fb6543f4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153417 Sep 11 05:36:10.284829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 402/798] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:11.307775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:11.308344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:11.314665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:11.315145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:11.315577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:11.316291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:11.316745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:11.317165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:11.447174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:11.455948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc33dd9f-ee73-4f99-9c8a-325cdc0fb54f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152123 Sep 11 05:36:11.456542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 397/799] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:12.478865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:12.479399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:12.486067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:12.486555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:12.487006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:12.487715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:12.488202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:12.488645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:12.618472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:12.627892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb951f22-5d79-4db5-bcde-5ee5e6494e60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152930 Sep 11 05:36:12.628703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 403/800] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:13.655108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:13.655897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:13.663071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:13.663511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:13.663985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:13.666770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:13.666770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:13.666770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:13.808749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:13.817856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eaf11c78-941e-4894-b69a-35b3a73af6ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.168427 Sep 11 05:36:13.818422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 398/801] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:14.841159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:14.841770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:14.848497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:14.848925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:14.849366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:14.850055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:14.850515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:14.850940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:14.980616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:14.989110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8cfa9408-69fd-4c37-8c7e-ddd16398fd38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151789 Sep 11 05:36:14.989682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 404/802] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:16.013151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:16.013767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:16.021262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:16.021825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:16.022393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:16.022972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:16.023402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:16.023940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:16.154575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:16.163574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffa191e5-0ceb-49de-9a9e-259059bcc4aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154583 Sep 11 05:36:16.164162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 399/803] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:17.186403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:17.187007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:17.193313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:17.193817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:17.194248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:17.194929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:17.195378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:17.195795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:17.320776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:17.329191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2c0a907-425f-4ca6-a87e-b025b213d91e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.146569 Sep 11 05:36:17.329749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 405/804] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:18.353610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:18.354222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:18.361468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:18.361946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:18.362378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:18.363061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:18.363514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:18.363934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:18.496507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:18.505594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d51b8e98-06f2-4de3-b1f7-dbc622e36cdc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155798 Sep 11 05:36:18.506164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 400/805] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:19.534964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:19.535507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:19.541844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:19.542326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:19.542752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:19.543431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:19.544230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:19.544328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:19.675520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:19.683602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35243e0d-fead-49c2-a23d-783b99269999 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152541 Sep 11 05:36:19.684210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 406/806] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:20.706707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:20.707363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:20.713751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:20.714241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:20.714685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:20.715379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:20.715840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:20.716298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:20.848990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:20.857124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4342b939-4bf1-41fd-a90c-bd56a1f1418a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154267 Sep 11 05:36:20.857634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 401/807] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:21.051912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:21.052459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:21.058269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.058748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.059183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.059865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.060356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.060807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.239366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e5fa0e05-3c15-4db4-894a-77f8df9eef75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/ips" status: 200 len: 148 microversion: 2.1 time: 0.287231 Sep 11 05:36:21.239832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 407/808] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 05:36:20 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/ips => generated 148 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:21.251356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2a38aa1-e3c7-487e-b780-7e5920b0f0dd"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:36:21.253685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:21.259581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.260044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.260745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.261445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.261903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.262329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.339858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/os-volume_attachments HTTP/1.1 Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 74 Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:36:21.341623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {"volumeAttachment": {"volumeId": "b2a38aa1-e3c7-487e-b780-7e5920b0f0dd"}} Sep 11 05:36:21.344035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '5b2d846a-e822-4339-959c-f0bf2303c954', 'body': {'volumeAttachment': {'volumeId': 'b2a38aa1-e3c7-487e-b780-7e5920b0f0dd'}}} Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:21.344983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:21.346472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 400 to user: Invalid volume: volume b2a38aa1-e3c7-487e-b780-7e5920b0f0dd is already attached to instances: c42e41e9-5297-4be5-a77d-6558fdb3b01f {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0056a63-b220-4aeb-ba9f-ac2acacb19f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098039 Sep 11 05:36:21.348161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 402/809] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 05:36:21 2022] POST /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:36:21.354513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:21.355013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:21.361162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.361645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.362083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.362772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.363232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.363657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.387885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:36:21.431753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:21.461964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da63e701-8ded-4702-ae52-e9f9cb5b4595 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 204 len: 0 microversion: 2.1 time: 0.111009 Sep 11 05:36:21.462537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 408/810] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:36:21 2022] DELETE /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:36:21.471395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:21.472033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:21.478240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.478727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.479163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.479845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.480326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.480749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.608887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:21.616619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-541b48d8-3240-4c06-9809-5960ba634d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.149794 Sep 11 05:36:21.617174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 403/811] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:21 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:21.881470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:21.882174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:21.884083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:21.890064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.890633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.891077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:21.891768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:21.892251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:21.892679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:22.026537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:22.034771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8127e0a1-1c89-4112-a5fc-92bfd236a8ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157540 Sep 11 05:36:22.035330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 409/812] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:22.641141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:22.641787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:22.648120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:22.648609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:22.649041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:22.649728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:22.650176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:22.650596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:22.781913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:22.789598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fae9a31d-5a83-47f1-bb7c-2789218c43df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.152984 Sep 11 05:36:22.790167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 404/813] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:22 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:23.058424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:23.058949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:23.066107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:23.066586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:23.067016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:23.067702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:23.068186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:23.068605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:23.194654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:23.203446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b4d170b-9898-4899-857c-89cebc2589ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148981 Sep 11 05:36:23.204021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 410/814] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:23.812610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:23.813234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:23.819858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:23.820397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:23.820848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:23.821551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:23.822012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:23.822442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:23.949059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:23.956837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9831f674-71c5-4b8a-80d1-fe9bfb4a4dc1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.148092 Sep 11 05:36:23.957390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 405/815] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:23 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:24.225910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:24.226550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:24.232879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:24.233411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:24.233932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:24.234628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:24.235087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:24.235531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:24.366829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:24.375022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aee6892b-7764-455f-94d3-df0283155c84 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152974 Sep 11 05:36:24.375584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 411/816] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:24.980234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:24.980849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:24.988039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:24.988525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:24.988962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:24.989650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:24.990104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:24.990525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:25.121036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:25.129811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50324bda-08cc-4202-acc3-b23f0bd044a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153438 Sep 11 05:36:25.130367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 406/817] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:24 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:25.398494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:25.399102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:25.406229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:25.406925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:25.407361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:25.408105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:25.408554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:25.408970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:25.542146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:25.552034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18b79e1e-0b71-481a-b7b6-add859ac6da2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157231 Sep 11 05:36:25.552700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 412/818] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:26.152632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:26.153287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:26.159823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:26.160346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:26.160790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:26.161478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:26.161933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:26.162358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:26.291352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:26.298966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd250478-0c9f-4224-9d2d-f52aa7947c0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.150171 Sep 11 05:36:26.299519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 407/819] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:26 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:26.575558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:26.576203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:26.582866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:26.583344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:26.583776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:26.584498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:26.584949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:26.585368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:26.715952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:26.729816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7168c831-7c67-4ff1-94b8-b8aaa07cbeb9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157987 Sep 11 05:36:26.730398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 413/820] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:27.322494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:27.323102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:27.325363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=34 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:27.331595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:27.332122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:27.332565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:27.333270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:27.333731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:27.334161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:27.464220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:27.472503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49c67f4a-3e21-46b6-b567-09c5f998f8d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153807 Sep 11 05:36:27.473079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 408/821] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:27 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:27.755002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:27.755546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:27.762141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:27.762623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:27.763058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:27.763842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:27.764321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:27.764773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:27.891576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:27.900298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a33e38da-319b-425a-bee9-8451f13b3cab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149246 Sep 11 05:36:27.900853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 414/822] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:28.497512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:28.498127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:28.504868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:28.505354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:28.505791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:28.506488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:28.507227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:28.507671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:28.645943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:28.649546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:28.659475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d203b9e8-6b14-428f-87e1-fbd60ce9e4e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.166066 Sep 11 05:36:28.660066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 409/823] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:28 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:28.923186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:28.923819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:28.930170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:28.930651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:28.931087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:28.931778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:28.932259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:28.932682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:29.059142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:29.067983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a4b7327-87ee-4ab9-8bc2-2e69f16acc39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149046 Sep 11 05:36:29.068575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 415/824] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:29.683572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:29.684220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:29.691769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:29.692318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:29.692760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:29.693460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:29.693939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:29.694353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:29.822747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:29.830687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff9c1746-daf8-4ee4-a7f1-1b2adfa547b4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.150889 Sep 11 05:36:29.831263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 410/825] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:29 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:30.092186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:30.093443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:30.099130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:30.099616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:30.100084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:30.100783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:30.101246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:30.101680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:30.234605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:30.242746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e925ab5f-d58d-4f5b-b4ea-830863cfeb9f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154704 Sep 11 05:36:30.243303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 416/826] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:30.855531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:30.856178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:30.862724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:30.863209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:30.863647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:30.864370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:30.864831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:30.865256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:30.996487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:31.004817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c811fb0-1ac9-4b56-8d21-20b60e24b5ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153243 Sep 11 05:36:31.005372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 411/827] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:30 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:31.266265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:31.266898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:31.273324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:31.273809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:31.274245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:31.274935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:31.275389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:31.275811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:31.403213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:31.412608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-347e2e2b-6aa4-4424-b330-d67f5e208e55 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150166 Sep 11 05:36:31.413180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 417/828] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:32.028317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:32.028933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:32.035408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:32.035894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:32.036364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:32.037055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:32.037512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:32.037935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:32.164082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:32.172341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe596303-fc53-49dd-a9c1-91aa58fc06fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.147961 Sep 11 05:36:32.172910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 412/829] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:32 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:32.437666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:32.438188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:32.444969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:32.445613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:32.446053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:32.447053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:32.447650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:32.448110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:32.581313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:32.589913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e17bf649-96a8-4330-aa53-cfe1c1d2d55a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156761 Sep 11 05:36:32.590479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 418/830] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:33.196482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:33.197109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:33.204521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:33.205005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:33.205444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:33.206136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:33.206590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:33.207016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:33.337769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:33.346637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-895e96e1-33ce-4779-ad05-3036d2d8a54d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.154032 Sep 11 05:36:33.347195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 413/831] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:33 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:33.612975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:33.613612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:33.620146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:33.620622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:33.621055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:33.621757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:33.622195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:33.622614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:33.751146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:33.759275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5c8b5de-60c6-44cc-aec1-2b7d06592737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150214 Sep 11 05:36:33.759842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 419/832] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:34.368740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:34.369368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:34.375834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:34.376352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:34.376796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:34.377493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:34.377993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:34.378420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:34.508693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:34.516912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cff8bd5-4623-498c-b874-accc9d69e323 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.151954 Sep 11 05:36:34.517467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 414/833] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:34 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:34.784173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:34.784710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:34.791143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:34.791625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:34.792086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:34.792787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:34.793243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:34.793667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:34.921511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:34.929855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-21b1d136-b54e-4926-83ed-9a84a7172230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150317 Sep 11 05:36:34.930419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 420/834] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:35.540548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:35.541166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:35.548229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:35.548711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:35.549148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:35.549838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:35.550289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:35.550712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:35.677559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:35.685190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2023a2c0-eff8-45fd-a5f2-617a505a2040 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.148495 Sep 11 05:36:35.685745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 415/835] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:35 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:35.953010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:35.953545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:35.959908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:35.960427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:35.960863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:35.961547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:35.962006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:35.962423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:36.092461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:36.101186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-254933e9-1d64-4714-a244-5ae704b29ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152194 Sep 11 05:36:36.101751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 421/836] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:36.708636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:36.709247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:36.715798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:36.716314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:36.716751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:36.717438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:36.717945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:36.718362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:36.850463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:36.858113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c8f70c5-d7b9-4fa0-8b90-68dbfe79cc38 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153289 Sep 11 05:36:36.858679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 416/837] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:36 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:37.126373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:37.126984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:37.133674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:37.134173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:37.134608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:37.135293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:37.136024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:37.136514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:37.262182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:37.270197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-823f48a1-7719-4afb-8a57-ebec1b82bc48 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148597 Sep 11 05:36:37.270754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 422/838] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:37.883050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:37.883670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:37.890999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:37.891486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:37.891927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:37.892661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:37.893120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:37.893554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:38.020193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:38.027939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7987a98b-c48b-442f-ac3c-dda22922a1aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.148738 Sep 11 05:36:38.028529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 417/839] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:37 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:38.293943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:38.294480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:38.301044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:38.301531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:38.301970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:38.302661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:38.303124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:38.303547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:38.433929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:38.442741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2fe713d5-d845-43d1-9496-f4feed4d2984 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152789 Sep 11 05:36:38.443306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 423/840] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:39.051842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:39.052395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:39.058728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:39.059209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:39.059665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:39.060373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:39.060824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:39.061241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:39.190880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:39.198608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb8432f8-ca3f-4273-9437-45699c3a2285 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.150667 Sep 11 05:36:39.199176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 418/841] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:39 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:36:39.465798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:39.466413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:39.473361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:39.473851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:39.474323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:39.475021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:39.475482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:39.475913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:39.601668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:39.609959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b410811d-02d6-4540-9762-9647f38892f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147980 Sep 11 05:36:39.610536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 424/842] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:40.222255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:40.222877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:40.229310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:40.229801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:40.230242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:40.231038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:40.231500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:40.231926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:40.363945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:40.372548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1aae629-3341-48d9-b2a6-e247441549b0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.154150 Sep 11 05:36:40.373121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 419/843] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:40 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:40.633760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:40.634402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:40.641660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:40.642149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:40.642597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:40.643295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:40.643752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:40.644213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:40.646719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:40.779669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:40.788546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e8c1073-f782-47c3-a717-8f091a3e0830 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158612 Sep 11 05:36:40.790495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 425/844] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:41.397148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:41.397789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:41.404168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:41.404645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:41.405080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:41.405793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:41.406246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:41.406662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:41.534771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:41.542404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a7559dd-9f21-40e4-95a9-30c5c4c43636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.149324 Sep 11 05:36:41.542966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 420/845] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:41 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:41.811827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:41.813795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:41.822698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:41.823216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:41.823846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:41.824707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:41.825171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:41.825603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:41.961289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:41.970044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34adc853-7b8a-41cc-9d5e-38f2faa91790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161929 Sep 11 05:36:41.970589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 426/846] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:42.052597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:42.053018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:42.058921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.059401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.059834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.060551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.061005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.061429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.091910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f125592c-46fe-47ff-b2e7-71c3181597e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments/e347d3b8-9207-43b5-9cc0-68d3e996e2fe" status: 200 len: 194 microversion: 2.20 time: 0.043583 Sep 11 05:36:42.092505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 421/847] 10.222.0.33 () {60 vars in 1454 bytes} [Sun Sep 11 05:36:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments/e347d3b8-9207-43b5-9cc0-68d3e996e2fe => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:42.160142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:42.160637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:42.166407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.166892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.167331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.168051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.168514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.168943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.247398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lazy-loading 'services' on Instance uuid 2851309b-4933-4d3c-950d-e9d28f857dfe {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:36:42.317915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-27632431-6f96-49f2-9af0-dbe377fa8fe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments/e347d3b8-9207-43b5-9cc0-68d3e996e2fe" status: 202 len: 0 microversion: 2.20 time: 0.161679 Sep 11 05:36:42.318542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 427/848] 10.222.0.33 () {60 vars in 1457 bytes} [Sun Sep 11 05:36:42 2022] DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments/e347d3b8-9207-43b5-9cc0-68d3e996e2fe => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:36:42.326910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:42.329643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:42.335544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.336070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.336514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.337210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.337668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.338097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.367461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdf980f3-18e5-4ee9-b380-255c24d4c68b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044504 Sep 11 05:36:42.368039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 422/849] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:42.567067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:42.567766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:42.573864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.574349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.574780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.575461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:42.575913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:42.576358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:42.708638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:42.716247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e623280-e026-4442-820b-129a3c799474 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153456 Sep 11 05:36:42.716803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 428/850] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:42 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:42.993200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:42.993843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:43.001187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.001703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.002142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.002828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.003279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.003704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.133936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:43.142344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-726e8566-9ace-4cc2-8159-459293497d6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152948 Sep 11 05:36:43.142897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 423/851] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:43.380803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:43.383113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:43.389716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.390868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.391719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.392501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.392959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.393384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.423380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d8e282f0-b8bd-4349-8327-c78dd28ce12a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046521 Sep 11 05:36:43.423953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 429/852] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:43.740738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:43.741348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:43.747652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.748170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.748603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.749452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:43.750632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:43.751113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:43.882978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:43.891591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0665fe92-7c6e-497d-bc3b-48f3db2712ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.154994 Sep 11 05:36:43.892270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 424/853] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:43 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:44.165170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:44.165705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:44.171572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.172083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.172652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:44.173356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.173799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.174224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:44.305054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:44.314035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2eaf54b0-8182-4656-9b3a-50f75e548a76 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152788 Sep 11 05:36:44.314609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 430/854] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:44.436245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:44.439444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:44.446366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.446905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.447481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:44.448475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.449078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.449511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:44.479199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c679d80b-0bf6-4999-b181-467c82499b3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047062 Sep 11 05:36:44.479959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 425/855] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:44.915477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:44.916129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:44.923319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.923804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.924273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:44.924972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:44.925442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:44.925863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:45.057545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:45.065115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce015443-8b06-44a1-a378-bfc6f7a86335 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.153619 Sep 11 05:36:45.065685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 431/856] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:44 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:45.338408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:45.339050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:45.345993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:45.346470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:45.346903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:45.347586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:45.348062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:45.348487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:45.363306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:45.480948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:45.489635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70e82161-3c80-4f2d-9636-9d94ac35d0b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155072 Sep 11 05:36:45.490196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 426/857] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:45.491005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:45.493278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:45.499076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:45.499552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:45.499985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:45.501459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:45.501994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:45.502418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:45.531976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-793e9a52-9642-44df-adad-73b36993dc04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045021 Sep 11 05:36:45.532703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 432/858] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:46.087871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:46.088562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:46.094716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.095204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.095647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.096455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.096955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.097401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.226330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:46.234028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-255028b6-9d05-4b5c-867c-e3b4110f0541 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1680 microversion: 2.1 time: 0.149968 Sep 11 05:36:46.234649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 427/859] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:46 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:46.514255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:46.514867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:46.521856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.522504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.523229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.524508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.525329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.526103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.547132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:46.550526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:46.557161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.557899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.558343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.559049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:46.559499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:46.559920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:46.593155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6523078-1ffb-4fb8-8da4-91583fc5bcf4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052419 Sep 11 05:36:46.593739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 428/860] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:46.673487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:46.681739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca66f4df-5bf5-44c9-8bd9-025c6179bbc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.171651 Sep 11 05:36:46.682507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 433/861] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:47.257977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:47.258692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:47.264967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.265451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.265925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.267121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.267771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.268227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.347039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:47.354697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86f927f1-8dfa-443b-a03b-3924822e2c17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1612 microversion: 2.1 time: 0.100603 Sep 11 05:36:47.355271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 429/862] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:47 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:47.466560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2d846a-e822-4339-959c-f0bf2303c954", "name": "network-vif-deleted", "tag": "4672c306-0b8f-4269-889c-67700ff9caba"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:36:47.476255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.476733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.477339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.489838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] Creating event network-vif-deleted:4672c306-0b8f-4269-889c-67700ff9caba for instance 5b2d846a-e822-4339-959c-f0bf2303c954 on hv-cinder-85692 Sep 11 05:36:47.495734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-7d9ee1c9-36aa-4800-b93e-5d7fea463e97 req-3bdecf1e-ef2f-48f2-9fb5-281191ad7ed5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Sep 11 05:36:47.497409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 434/863] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:47.605914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:47.608129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:47.615807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.616331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.616766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.617469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.617924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.618350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.650142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d71e66c9-04da-407b-a1a0-18507cdae231 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048513 Sep 11 05:36:47.650981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 430/864] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:47.706732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:47.707429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:47.713647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.714010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.714448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.715155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:47.716025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:47.716025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:47.853250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:47.862925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74af86d3-7287-4e30-8262-6ab3b9062eba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161186 Sep 11 05:36:47.863684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 435/865] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:48.379400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:48.380120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:48.391601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.392412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.393032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.394195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.394822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.396801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.429834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.430331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.430775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.431231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'fault' on Instance uuid 5b2d846a-e822-4339-959c-f0bf2303c954 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:36:48.481644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:48.491356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66b422da-3188-4d1a-9336-bff1b354e7e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1331 microversion: 2.1 time: 0.116526 Sep 11 05:36:48.492170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 431/866] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:48 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:48.664933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:48.667099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:48.673764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.674493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.674931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.675641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.676119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.676546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.707714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8678e63f-3bb4-4b6a-b961-a1c93b84559f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046965 Sep 11 05:36:48.708734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 436/867] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:48.887049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:48.887668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:48.894788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.895288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.895733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:48.896467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:48.896929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:48.897362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.183849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:49.193143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb937cca-c15d-4467-a994-e9ce6cb00c06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.310227 Sep 11 05:36:49.193710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 432/868] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:49.515150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:49.516374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:49.524181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:49.524677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:49.525255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.525969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:49.526424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:49.526860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.559244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:49.559729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:49.560195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.560642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'fault' on Instance uuid 5b2d846a-e822-4339-959c-f0bf2303c954 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:36:49.601801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:49.611959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-259cd133-055c-483b-97dd-53a550050c27 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 200 len: 1331 microversion: 2.1 time: 0.100485 Sep 11 05:36:49.624053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 437/869] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:49 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:49.720923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:49.723024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:49.728916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:49.729402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:49.729838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.730520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:49.730973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:49.731397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:49.760006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501cbc57-6f27-4248-ac63-f2e26b449232 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043762 Sep 11 05:36:49.760827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 433/870] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:50.216858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.217475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.223902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.224427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.224870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.225572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.226032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.226456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.364608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:50.372671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-568145a2-00ee-43d2-8b5f-a15828b901a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1714 microversion: 2.1 time: 0.159977 Sep 11 05:36:50.373227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 438/871] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:50.435174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.435707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.443402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.443944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.444369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.445064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.445554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.445986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.525863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Cannot 'detach_volume' instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 while it is in vm_state rescued Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:36:50.527395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:36:50.529102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Cannot 'detach_volume' instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 while it is in vm_state rescued Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:36:50.529966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 while it is in vm_state rescued Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 while it is in vm_state rescued Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.531607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 409 to user: Cannot 'detach_volume' instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 while it is in vm_state rescued {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:36:50.533206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d278023-fa32-4bb7-97f9-04311f3bb369 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 409 len: 152 microversion: 2.1 time: 0.097625 Sep 11 05:36:50.533206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 434/872] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:36:50 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 05:36:50.538355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:36:50.538897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.544852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.545339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.545814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.546511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.547491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.548069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.613480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc609c1c-64b1-4e63-bf9a-2bd94c92598e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action" status: 202 len: 0 microversion: 2.1 time: 0.078863 Sep 11 05:36:50.614097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 439/873] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:36:50 2022] POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:36:50.622460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.623115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.629997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.630481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.630912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.631607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.632162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.633317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.636227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.636953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.643084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.643581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.644045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.644759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.645215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.645640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.661431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 HTTP/1.1 Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:36:50.663509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 05:36:50.664909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '5b2d846a-e822-4339-959c-f0bf2303c954'} Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:36:50.665692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 05:36:50.666904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:36:50.669745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:36:50.669745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0a2818c-7c9a-44ac-aa96-a667067f4f09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 404 len: 111 microversion: 2.1 time: 0.033069 Sep 11 05:36:50.669745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 440/874] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:50 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 05:36:50.675471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb41ecbb-f8f8-44cb-9a00-d7d11f64b44d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '.version_select at 0x7f2c3f00a160>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.696154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb41ecbb-f8f8-44cb-9a00-d7d11f64b44d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011234736" status: 202 len: 0 microversion: 2.1 time: 0.025933 Sep 11 05:36:50.696833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 441/875] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 11 05:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011234736 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:36:50.773736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:50.776426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:50.783979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.783979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.784496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.785588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:50.786074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:50.786593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:50.807471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:50.810470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:50.820048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f1e289e-3577-482d-9e01-51acc95f377e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1722 microversion: 2.1 time: 0.201462 Sep 11 05:36:50.820966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 435/876] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:50.832178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8d40321-a030-4b15-8012-058d278972a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062761 Sep 11 05:36:50.833339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 442/877] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:51.439546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:51.440154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:51.446985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.447553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.448340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.449079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.449688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.450122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.528979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'services' on Instance uuid c42e41e9-5297-4be5-a77d-6558fdb3b01f {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:36:51.600833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6ac4e75-b192-42f4-a23d-12b5ac3e313b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments/b2a38aa1-e3c7-487e-b780-7e5920b0f0dd" status: 202 len: 0 microversion: 2.1 time: 0.165721 Sep 11 05:36:51.601646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 436/878] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:36:51 2022] DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments/b2a38aa1-e3c7-487e-b780-7e5920b0f0dd => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:36:51.610950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:51.613165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:51.620737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.621266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.621993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.623706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.624423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.624879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.655415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4733c6f-16b1-409a-a661-79f1c6e27977 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049279 Sep 11 05:36:51.655970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 443/879] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:36:51.845332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:51.845604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:51.846181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:51.847886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:51.852459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.852950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.853395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.853682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.854109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.854235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.854571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.854693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.855004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.855262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:51.855711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:51.856165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:51.886815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb0e44a0-6547-420a-8ba1-1d5cf8cf14c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045817 Sep 11 05:36:51.887377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 444/880] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:51.990230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:51.998434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ccc7c36a-e968-4d7d-bf3d-cb08054ace99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1722 microversion: 2.1 time: 0.157990 Sep 11 05:36:51.998992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 437/881] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:52.668433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:52.670585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:52.673052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:52.678408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:52.678896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:52.679345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:52.680070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:52.680533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:52.680961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:52.711310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4fde5ffb-8986-4941-9b77-827d5140e15f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Sep 11 05:36:52.711873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 445/882] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:52.900163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:52.902443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:52.909571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:52.910058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:52.910500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:52.911196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:52.911660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:52.912110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:52.942924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5d4c1e8-27e8-4f3b-a97c-f2b51d9255a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046776 Sep 11 05:36:52.943405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 438/883] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:53.022860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:53.023480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:53.029388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.029875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.030316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.031005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.031648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.032113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.162727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:53.171092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-042672cf-f610-4bf1-b390-cb5901f8f508 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1722 microversion: 2.1 time: 0.152171 Sep 11 05:36:53.171659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 446/884] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:53.724621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:53.726743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:53.732767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.733254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.733694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.734399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.735793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.736285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.764973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a154317b-bcb5-4521-b6ae-4fc60783c078 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Sep 11 05:36:53.765510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 439/885] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:53.954969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:53.957146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:53.963916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.964462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.965012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.965659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:53.966124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:53.966652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:53.998149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-912aa3fc-049d-47a7-b759-48ad8def1be2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047161 Sep 11 05:36:53.998721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 447/886] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:54.194012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:54.194657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:54.200952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:54.201477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:54.201856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:54.202545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:54.203001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:54.204070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:54.330918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:54.339019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14e9b37d-a70e-4829-887f-c5af36bc9ab3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1722 microversion: 2.1 time: 0.148841 Sep 11 05:36:54.339566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 440/887] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:54.777730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:54.779885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:54.786320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:54.786807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:54.787256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:54.787987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:54.788525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:54.788900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:54.819349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0856d4b8-89ce-4561-bcd6-e4d7d5de3beb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 11 05:36:54.819898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 448/888] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:55.010186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:55.012648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:55.018958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.019454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.019925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.020678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.021192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.021624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.051026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b79f178e-6f4a-489f-afbd-2eeb2361a10c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Sep 11 05:36:55.051504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 441/889] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:55.363787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:55.364444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:55.370767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.371256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.371698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.372426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.372894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.373322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.500981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:36:55.509242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01737db2-5c4a-4a43-9ec5-0d82469f3636 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1728 microversion: 2.1 time: 0.149873 Sep 11 05:36:55.509809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 449/890] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:36:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:36:55.532519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:55.533084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:55.539307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.539798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.540280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.540982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.541448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.541884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.545566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:55.624089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6ddda32-f03d-44f7-8c11-a4026eebed36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095868 Sep 11 05:36:55.624681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 442/891] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:36:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:55.832096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:55.834299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:55.840530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.841025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.841466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.842212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:55.842672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:55.843104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:55.875569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44d3bd95-fab2-43db-9557-334ee23f2c9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Sep 11 05:36:55.876080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 450/892] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:56.063730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:56.066210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:56.072262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:56.072746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:56.073179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:56.073865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:56.074318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:56.074740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:56.104406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8c392d9-f081-4278-9123-69a70ef0ea52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045421 Sep 11 05:36:56.105149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 443/893] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:56.757483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:36:56.770724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:56.771209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:56.771668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:56.784092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] Creating event network-changed:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 05:36:56.789193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b0026c19-a526-4504-8342-9a8e7d644eed req-e4fab17e-2350-41be-a4e7-a2c2f31b1998 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Sep 11 05:36:56.789783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 451/894] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:36:56.888439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:56.891488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:56.898373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:56.899180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:56.899716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:56.900527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:56.901238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:56.901735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:56.933030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00c18f3a-8fa7-426f-be8c-ce40e85ae1f5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Sep 11 05:36:56.933735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 444/895] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:57.117875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:57.120368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:57.127701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:57.128307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:57.128803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:57.129676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:57.130127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:57.130553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:57.163862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4790cb85-5526-4daa-aeb0-e897fb7d3d65 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050493 Sep 11 05:36:57.164366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 452/896] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:36:57.948829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:57.952947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:57.955831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=76 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:36:57.962924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:57.963417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:57.963864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:57.964775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:57.965479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:57.965916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:58.005765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8acd939a-09ad-4df6-ac25-0b5d6bd6718e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063468 Sep 11 05:36:58.006349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 445/897] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:58.178219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:58.180833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:58.187252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:58.187879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:58.188455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:58.189155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:58.189656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:58.190075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:58.224355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a6a5746-2058-40c3-a1a2-4051f4a479df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051490 Sep 11 05:36:58.225075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 453/898] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:36:58.805290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:36:58.815704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:58.816225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:58.816661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:58.827795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] Creating event network-changed:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 05:36:58.833209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1f817d70-f543-4580-bfa4-fa4778a2f4b3 req-14a4a82f-777c-4650-8a9f-17e6eb7a10fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032389 Sep 11 05:36:58.834036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 446/899] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:59.020980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:59.023180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:59.029024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:59.029507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:59.030017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:59.030709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:59.031681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:59.032135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:59.064246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dcf6b3fa-a416-4865-ab26-eaf762d03e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047644 Sep 11 05:36:59.064802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 454/900] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:36:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:36:59.237846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:36:59.240170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:36:59.246327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:59.246813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:59.247256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:59.248230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:36:59.248690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:36:59.249119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:36:59.280252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6168e84d-2efe-4433-b65f-c17dd79470f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046820 Sep 11 05:36:59.280804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 447/901] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:36:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:00.076600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:00.079061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:00.085044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.085522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.085954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.086642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.087093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.087516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.117588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f4588b1-a4cc-41dd-a2e5-c3f7b922af0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Sep 11 05:37:00.118145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 455/902] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:00.231230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:00.231731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:00.238135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.238702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.239047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.239736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.240236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.240667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.266590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:37:00.292972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:00.295121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:00.301751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.302421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.302873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.303740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.304311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.304872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.337636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18a57965-981e-4fc0-a4c2-c0052bb8619e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048519 Sep 11 05:37:00.343021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 456/903] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:00.347228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64f987ac-eef2-4616-96bb-cf1358bf0798 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 204 len: 0 microversion: 2.1 time: 0.119462 Sep 11 05:37:00.347873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 448/904] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:37:00 2022] DELETE /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:37:00.355904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:00.356546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:00.363335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.363462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.363876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.364640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:00.365107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:00.365538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:00.504526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:00.512493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99725109-8495-43e5-8992-3797ba7c1e40 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1580 microversion: 2.1 time: 0.160387 Sep 11 05:37:00.513105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 457/905] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:00 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:01.131250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:01.133438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:01.139607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.140136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.140641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.141334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.141793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.142219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.170807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52d796ae-250c-423a-8cb8-974ca0229eaf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Sep 11 05:37:01.171347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 449/906] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:01.351008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:01.353279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:01.360606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.361090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.361527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.362218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.362673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.363098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.393567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00eb36d9-c936-4914-8824-e7e858c30a4a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046526 Sep 11 05:37:01.394130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 458/907] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:01.537461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:01.538078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:01.544474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.544956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.545393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.546086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:01.546543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:01.547004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:01.677830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:01.685618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-082bb532-1014-43b5-832c-454a499ff45d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1580 microversion: 2.1 time: 0.152020 Sep 11 05:37:01.686176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 450/908] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:01 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:02.183016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:02.185259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:02.191886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.192403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.192844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.193570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.194026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.194460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.208696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:02.224549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da503afe-da0d-45c4-af96-3b852560d4e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Sep 11 05:37:02.225118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 459/909] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:02.406037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:02.408455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:02.414401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.414894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.415338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.416060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.416521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.416953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.447626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a1ba77a-598d-4283-ae27-3c46d18e6f0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045566 Sep 11 05:37:02.448249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 451/910] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:02.708978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:02.709553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:02.716102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.716597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.717042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.717771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:02.718231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:02.719205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:02.851938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:02.860409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f109912-3a0b-4bed-b202-9e95a4d9274c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1580 microversion: 2.1 time: 0.155443 Sep 11 05:37:02.860959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 460/911] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:02 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:03.238304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:03.240686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:03.247020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.247430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.247865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.248670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.249247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.249681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.279813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f58bc29-68d7-41c9-a673-c3b47ec20bd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Sep 11 05:37:03.280402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 452/912] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:03.422316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c14da8-f044-490c-86b4-f1cef62ed399", "name": "network-vif-deleted", "tag": "093315a6-9a45-437a-9309-ab0159b8dae1"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:37:03.434607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.435092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.435534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.448856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] Creating event network-vif-deleted:093315a6-9a45-437a-9309-ab0159b8dae1 for instance c4c14da8-f044-490c-86b4-f1cef62ed399 on hv-cinder-85692 Sep 11 05:37:03.455845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-e926b30f-1a47-4b35-a3b0-abc2847977c9 req-e93547e8-0eee-4c89-9e85-57af5fc123fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037423 Sep 11 05:37:03.456858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 461/913] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:03.463582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:03.466654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:03.473710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.474203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.474643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.475348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.475825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.476448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.511283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5edd5919-021e-47ec-80c6-b0c4eca2ee5f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054272 Sep 11 05:37:03.512188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 453/914] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:03.883325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:03.884048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:03.891660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.892181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.892661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.893403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:03.893866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:03.894323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:03.957366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:03.965198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-491c9143-a1e6-4723-8ee7-364c62d4e63e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086090 Sep 11 05:37:03.966064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 462/915] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:03 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:04.292527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:04.294861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:04.301459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.301944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.302380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:04.303081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.303661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.304127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:04.334601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68b69702-7595-45b1-8407-bd0996fc709e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046169 Sep 11 05:37:04.335075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 454/916] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:04.524524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:04.526659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:04.533586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.534064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.534497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:04.535181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.535661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.536118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:04.567515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fab640d-6a89-4abc-ba78-8122f53a5672 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047137 Sep 11 05:37:04.568077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 463/917] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:04.988789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:04.989337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:04.995224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.995711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.996199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:04.996897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:04.997357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:04.997788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:05.058888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:05.067055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e528dab2-3a86-4171-a003-c994f771974c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082227 Sep 11 05:37:05.067612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 455/918] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:05.347552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:05.349719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:05.356014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:05.356512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:05.356943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:05.357627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:05.358077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:05.358495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:05.389271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16916891-ac05-4ad8-a1a5-57f007d4168a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Sep 11 05:37:05.389815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 464/919] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:05.580042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:05.582228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:05.588562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:05.589048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:05.589481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:05.590213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:05.590662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:05.591083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:05.621355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3391d87f-37fe-4c21-a539-3142313edf98 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045643 Sep 11 05:37:05.621819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 456/920] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:06.090341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:06.090945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:06.097851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.098329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.098763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.099449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.099897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.100341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.164201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:06.171854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94771eb4-588d-46bb-8e5c-0f43e39d5c34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085408 Sep 11 05:37:06.172440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 465/921] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:06 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:06.401560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:06.403728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:06.409945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.410525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.410977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.411658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.412133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.412557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.444462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6692a156-012f-4a80-9c2f-0319baffce09 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Sep 11 05:37:06.445012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 457/922] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:06.634955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:06.637420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:06.644295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.644804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.645241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.645934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:06.646415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:06.646855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:06.677650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e5b84be-2a27-41bb-b8f7-0604df1ae448 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046626 Sep 11 05:37:06.678330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 466/923] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:07.195113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:07.195745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:07.202197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.202681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.203119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.203864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.204546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.204981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.207620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:07.273747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:07.281515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ba4b5c3-995f-4773-ab89-b7665e491d11 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.090316 Sep 11 05:37:07.282775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 458/924] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:07 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:07.457425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:07.459597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:07.465662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.466150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.466590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.467284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.467742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.468202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.499028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71d33afd-1dce-4d1f-ae4f-bd87bc6bf325 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Sep 11 05:37:07.499594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 467/925] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:07.690409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:07.692629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:07.698632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.699130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.699603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.700327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.700787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.701218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.731700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0258bc5b-7778-4f1c-9230-37f65dd09357 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045393 Sep 11 05:37:07.732279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 459/926] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:07.896464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:37:07.898677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:07.904965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.905461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.905872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.906556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.907828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.908404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.978474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa7ba365-bca2-4957-91fd-c62c3c9e3cf8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action" status: 202 len: 0 microversion: 2.1 time: 0.085767 Sep 11 05:37:07.980574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 468/927] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:37:07 2022] POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:37:07.986936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:07.987643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:07.993696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.994354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.995011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:07.995895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:07.996455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:07.996856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.304845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:08.305464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:08.311840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.312367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.312809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.314132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.314595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.315026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.380669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:08.388897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-33bb967d-8506-4137-8b3e-4f7e1f518160 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.088426 Sep 11 05:37:08.389471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 469/928] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:08 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:08.466403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:08.474684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82f51eac-b260-4c4c-9a60-449eff56d70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1749 microversion: 2.1 time: 0.491520 Sep 11 05:37:08.475252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 460/929] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1749 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:08.511884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:08.514132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:08.520145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.520639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.521084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.521805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.522280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.522687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.553128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11d4600b-cf17-4632-90c2-97735c43960c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Sep 11 05:37:08.553689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 470/930] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:08.744783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:08.747162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:08.754264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.754846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.755308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.756143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:08.756491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:08.756923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:08.787354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b80c1906-5717-438d-a383-f51e815d3681 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046528 Sep 11 05:37:08.787917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 461/931] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:09.411335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:09.411930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:09.418295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.418777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.419209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.419893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.420369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.420788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.484120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:09.492430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b91d0d9-6c75-4617-931c-feba6454a3b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085271 Sep 11 05:37:09.492992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 471/932] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:09 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:09.498894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:09.499611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:09.506751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.507323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.507892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.508612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.509070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.509496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.566154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:09.568433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:09.574359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.574935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.575431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.576157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.576616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.577042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.606714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46d24344-6bea-4adc-a222-baaa97554716 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Sep 11 05:37:09.607275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 472/933] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:09.655931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:09.664193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d3221fc-5278-49ed-841b-39530eeba847 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.169003 Sep 11 05:37:09.664689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 462/934] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:09.799821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:09.802138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:09.808182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.808667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.809102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.809794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:09.810275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:09.810696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:09.842130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3393f03-d4ad-4135-bebf-da391d2c558b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Sep 11 05:37:09.842683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 473/935] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:10.514832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:10.515451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:10.521975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.522491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.522935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.523639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.524133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.524564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.588297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:10.596660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3b49af5-d8e2-4ba5-87d8-77907271ba80 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085973 Sep 11 05:37:10.597219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 463/936] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:10 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:10.618830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:10.621064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:10.627617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.628142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.628585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.629280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.629762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.630191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.660376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9dba59ee-cecf-4d23-9b06-ec25580dc477 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Sep 11 05:37:10.660934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 474/937] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:10.687752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:10.688417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:10.694317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.694805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.695246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.695941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.696427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.696857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.839774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:10.848662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f3aff8d-3eb9-4978-8549-aa29bf595c53 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.164735 Sep 11 05:37:10.849232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 464/938] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:10.854846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:10.857020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:10.863314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.863797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.864254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.864945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:10.865395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:10.865819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:10.890571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:10.896441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0a060d7-10bb-4b11-8012-5af733bd745a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045546 Sep 11 05:37:10.897109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 475/939] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:11.619457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:11.620105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:11.627251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.627734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.628206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.628907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.629363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.629791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.673881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:11.676184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:11.684043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.684599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.685109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.685804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.686254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.686675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.692971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:11.700755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5a7619b-c599-42e9-9926-f52312a8b81b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085219 Sep 11 05:37:11.701320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 465/940] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:11 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:11.717908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-72dab533-64dc-4574-823e-8d5fa24456fa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Sep 11 05:37:11.718442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 476/941] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:11.872819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:11.873357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:11.879760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.880279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.880722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.881411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.881867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.882299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.913767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:11.916219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:11.923543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.924131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.924556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.925342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:11.925800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:11.926293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:11.957461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7e1f62b-a395-4941-a735-be1760d52691 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049026 Sep 11 05:37:11.958025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 477/942] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:12.035059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:12.043238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b83954a-e82a-4d9b-bb7f-a2506c22c9c9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.174466 Sep 11 05:37:12.043799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 466/943] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:12.724893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:12.730655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:12.732813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:12.736186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:12.740314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.740802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.741238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:12.741931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.742385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.742808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:12.742966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.743459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.743900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:12.744886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.745348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.745776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:12.776240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80c8bee9-5b71-4f21-9df8-20f2813d7ff3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049302 Sep 11 05:37:12.776727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 467/944] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:12.814947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:12.822565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd3df188-22d8-445f-94c2-252988cef765 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.101652 Sep 11 05:37:12.823126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 478/945] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:12 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:12.970157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:12.972298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:12.978160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.978635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.979065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:12.979747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:12.980237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:12.980653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.010411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21485599-eeeb-4bdf-8a2b-b4d6a539696d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044513 Sep 11 05:37:13.011207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 468/946] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:13.066711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:13.067330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:13.073377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.073865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.074313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.075006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.075463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.075895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.424023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:13.432197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b6c23ee-53b4-4c84-8303-c882f076e76d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.369626 Sep 11 05:37:13.432762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 479/947] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:13.788775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:13.790846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:13.797353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.797921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.798275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.798965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.799418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.799842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.829669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5eb94f95-ab9d-467d-baca-5f57f00b3fc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Sep 11 05:37:13.830218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 469/948] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:13.846319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:13.846928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:13.853244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.853726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.854169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.854864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:13.855322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:13.855748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:13.916675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:13.924369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5b33f24-7e6e-4e66-af4b-a97933d61f55 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082492 Sep 11 05:37:13.924933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 480/949] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:13 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:14.023414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:14.025588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:14.031390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.031883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.032449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.033155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.033617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.034052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.063612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7db0dbb5-6f6b-4e52-b53a-8927780d6261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043477 Sep 11 05:37:14.064458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 470/950] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:14.456135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:14.456755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:14.462663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.463151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.463596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.464322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.464788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.465219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.612673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:14.620901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfc9e044-fd59-44ca-8c94-cca247a33292 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.168730 Sep 11 05:37:14.621477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 481/951] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:14.842090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:14.844899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:14.850951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.851429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.851862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.852575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.853025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.853445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.883000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95651ca2-c17a-4d10-95fe-bb2442d443b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Sep 11 05:37:14.883538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 471/952] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:14.946614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:14.947227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:14.953870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.954438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.954883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:14.955580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:14.956062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:14.956489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.018822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:15.026496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44e7ea46-2d6a-457c-96d9-ddfc0728bcae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083762 Sep 11 05:37:15.027011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 482/953] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:14 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:15.076270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:15.079048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:15.085209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.085705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.086148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.086843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.087306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.087738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.117171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-527d2bcd-914a-4dee-a984-08ee107a29f3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044856 Sep 11 05:37:15.117719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 472/954] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:15.645846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:15.646456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:15.652421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.652901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.653370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.654064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.654519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.654990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.796146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:15.804936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fdd38388-8a13-49b8-bbe8-a97824867182 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.163896 Sep 11 05:37:15.805681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 483/955] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:15.895365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:15.897571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:15.903750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.904259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.904688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.905369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:15.905816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:15.906240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:15.935602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98547bb7-fd29-47e9-a41e-844e455265ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Sep 11 05:37:15.936286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 473/956] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:16.048862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:16.049499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:16.055796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.056314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.056756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.057448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.057907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.058338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.123758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:16.129640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:16.131798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:16.132843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af2f0774-33ee-40c7-a8ec-cef2d1e36329 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087972 Sep 11 05:37:16.133472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 484/957] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:16 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:16.137988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.138478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.138922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.139654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.140143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.140577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.165073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:16.170180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d17d481e-a73b-4708-afaa-a4aed2c84b82 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045226 Sep 11 05:37:16.170734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 474/958] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:16.829515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:16.830129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:16.836261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.836753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.837197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.838508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.838978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.839408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.948466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:16.950860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:16.957449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.957935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.958368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.959076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:16.959533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:16.959962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:16.980558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:16.989432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0f438ec-6160-4430-8ac3-900c909aa032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.164543 Sep 11 05:37:16.990002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 485/959] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:16.990893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fff79d19-9603-4cd2-ae31-223477a7b188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Sep 11 05:37:16.991476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 475/960] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:17.157321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:17.157917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:17.164251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:17.164735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:17.165171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:17.165936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:17.166343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:17.166768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:17.182940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:17.185169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:17.191659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:17.192188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:17.192631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:17.193327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:17.193781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:17.194203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:17.225168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fbc32e4-e0bd-4719-aad8-bc02bc74eb96 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046126 Sep 11 05:37:17.225924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 476/961] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:17.230208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:17.238070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-087a2cd7-a9ba-4a85-81fd-fc93ff286031 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085222 Sep 11 05:37:17.238634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 486/962] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:17 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:18.003830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:18.006432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:18.012500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:18.013116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:18.013477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.013950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.014382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.015214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.015671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.016238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.019048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.019540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.020673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.021398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.021861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.022294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.050792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7a27d36-eb01-4a9b-91c4-c95204c4f5ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051349 Sep 11 05:37:18.051350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 477/963] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:18.169469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:18.177760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32d0f612-c60e-4a75-8b10-0c8fe69130b7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.169446 Sep 11 05:37:18.178319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 487/964] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:18.240796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:18.244391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:18.254317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.255088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.255688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.256606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.257427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.258296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.261128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:18.261766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:18.268481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.268995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.269432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.270129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:18.270583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:18.271003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:18.291225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c5985ff-c2b2-467b-8aa7-57fc4831e83b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057744 Sep 11 05:37:18.291786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 478/965] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:18.334467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:18.342112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2dc06994-6384-434f-9257-a3baf7dc3aa3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085210 Sep 11 05:37:18.342666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 488/966] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:18 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:19.064265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:19.066453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:19.072786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.073266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.073701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.074383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.074833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.075256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.104176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-596c2b53-ffa6-42e1-bd7f-37833baf66d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Sep 11 05:37:19.104711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 479/967] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:19.200480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:19.201081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:19.207692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.208213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.208652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.209345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.209798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.210220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.303843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:19.306116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:19.312013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.312511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.312949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.313649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.314099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.314572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.343689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56f30f53-936d-4183-9178-0b42e60c77f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043761 Sep 11 05:37:19.344797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 480/968] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:19.349876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:19.358140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5005d1e-95d8-4e41-bd37-0d5280eb24f9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.161523 Sep 11 05:37:19.358701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 489/969] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:19.365703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:19.366473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:19.372310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.372805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.373251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.373955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:19.374419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:19.374850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:19.436644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:19.444606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fe8b019-795a-4a87-abb9-5a5eb05f0d90 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082708 Sep 11 05:37:19.445162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 481/970] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:19 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:20.116598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:20.118818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:20.124749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.125236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.126177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.126868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.127323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.127748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.157376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8b2ce4e-316d-4653-aa7e-b7a83419dd19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 11 05:37:20.157942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 490/971] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:20.357015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:20.359178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:20.366111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.366596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.367085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.367722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.368208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.368634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.382411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:20.383141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:20.389754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.390242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.390684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.391386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.391849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.392475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.399060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86ae6819-e028-4ba7-b332-8047fedf2f54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 Sep 11 05:37:20.399617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 482/972] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:20.538999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:20.548419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea27f67d-2da1-4a2f-8de8-2470eb8e064d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.169101 Sep 11 05:37:20.549004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 491/973] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:20.572881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:20.573499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:20.579704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.580237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.580675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.581363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:20.581823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:20.582249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:20.643956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:20.651699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5cc1ade-ff24-4ce6-b80d-b61589400e34 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.188141 Sep 11 05:37:20.652298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 483/974] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:20 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:21.169832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:21.171986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:21.178071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.178556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.178997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.179695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.180184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.180616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.194344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:21.210924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9778dba0-58b4-423d-8226-cf41c8f2d778 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Sep 11 05:37:21.211478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 492/975] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:21.411529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:21.413834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:21.420337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.420765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.421207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.421904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.422377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.422913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.452937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e1e5033-556c-40dd-a134-25b758d7b792 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046111 Sep 11 05:37:21.453493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 484/976] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:21.572642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:21.573250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:21.580201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.580678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.581115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.581803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.582251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.582668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.674399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:21.674936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:21.680868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.681358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.681795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.682486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:21.682937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:21.683358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:21.724955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:21.733151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81c2357d-bfc5-478d-9f48-cd8333e3e4c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.164330 Sep 11 05:37:21.733720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 493/977] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:21.748919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:21.757305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f6d190c-926f-4e73-a574-4b4578414d17 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086984 Sep 11 05:37:21.757855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 485/978] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:21 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:22.223333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:22.225577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:22.231430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.231918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.232390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.233085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.233544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.233969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.263312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09639e25-729e-4807-b70b-bdaa65daeb5d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 11 05:37:22.263861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 494/979] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:22.466113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:22.468289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:22.475341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.475772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.476257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.476966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.477428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.477857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.507398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-857c694e-280c-47f0-a3b8-0e1ef3e88efe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045280 Sep 11 05:37:22.508052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 486/980] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:22.756942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:22.757493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:22.759841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:22.765234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.765720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.766664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.767541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.768028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.768570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.780459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:22.781068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:22.787830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.788419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.788865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.789894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:22.790705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:22.791512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:22.856711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:22.864844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f6ab65a-52ed-4afe-97b7-0645152e4935 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.088145 Sep 11 05:37:22.865420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 487/981] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:22 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:22.917351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:22.925523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d072e38e-b815-40f1-81a7-69c001915b20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.172598 Sep 11 05:37:22.926088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 495/982] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:23.274855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:23.277044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:23.282986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.283469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.283907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.284625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.285082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.285506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.314474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3570ccbc-1e8f-4934-9b3d-7e95461e2ea7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Sep 11 05:37:23.315009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 488/983] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:23.520214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:23.522347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:23.528286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.528707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.529139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.529825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.530273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.530694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.559283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7aa264bc-7762-4b5c-88dc-c00500da68fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043123 Sep 11 05:37:23.559824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 496/984] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:23.888261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:23.888877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:23.895501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.895990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.896465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.897163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.897622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.898054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.949471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:23.950086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:23.957048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.957968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.957968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.958636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:23.959085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:23.959508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:23.960252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:23.968088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-485d1ba2-d46a-4c28-b048-b145e4e3a585 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083958 Sep 11 05:37:23.968652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 489/985] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:23 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:24.099808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:24.107982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1898b528-a854-466f-8acd-dcd8f52db8ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.162397 Sep 11 05:37:24.108574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 497/986] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:24.327098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:24.330073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:24.335957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:24.336541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:24.336970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:24.337654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:24.338102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:24.338526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:24.368079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6305e546-7c20-4cc8-a196-4d1acb24bc75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Sep 11 05:37:24.368576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 490/987] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:24.572566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:24.574754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:24.581528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:24.582014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:24.582456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:24.583150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:24.583607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:24.584064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:24.613650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88798b84-174d-4e41-9464-6e6f915ed63b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045067 Sep 11 05:37:24.614198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 498/988] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:24.992341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:24.992880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:24.999237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:24.999725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.000238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.001635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.002095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.002530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.017375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:25.064306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:25.072015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a742f7ce-288e-46a8-9c09-081afb4517a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083657 Sep 11 05:37:25.072575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 491/989] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:24 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:25.131702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:25.132357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:25.139019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.139508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.139946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.140671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.141132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.141570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.283301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:25.291480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-467ae144-97bc-4e5e-a925-fbe598b52c68 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1754 microversion: 2.1 time: 0.163652 Sep 11 05:37:25.292067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 499/990] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:25.380294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:25.382464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:25.384472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:25.390025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.390850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.391065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.392289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.392752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.393187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.424350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b524a1e2-2e0f-4975-a45b-711e7deca79a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048565 Sep 11 05:37:25.424908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 492/991] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:25.625441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:25.628356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:25.634290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.634778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.635211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.636190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:25.636644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:25.637071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:25.666214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5c94a3c9-ee7b-4bee-ba72-7553552a7d60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Sep 11 05:37:25.666760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 500/992] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:26.095132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:26.095742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:26.102097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.102583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.103015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.103704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.104194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.104618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.168435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:26.176683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee4e47de-03fa-42dd-bb01-026be99661ae tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086026 Sep 11 05:37:26.177233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 493/993] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:26 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:26.314681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:26.315296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:26.321721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.322205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.322645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.323336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.323792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.324246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.437002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:26.439628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:26.445515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.446010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.446453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.447155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.447621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.448081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.465071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:26.473934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d000ed56-4421-45f2-b236-389e83e869b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1757 microversion: 2.1 time: 0.163209 Sep 11 05:37:26.474507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 501/994] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:26.479029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71f76929-4555-4f38-bedc-f24f47ace60a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045963 Sep 11 05:37:26.479573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 494/995] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:26.678824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:26.680975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:26.686840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.687322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.687763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.689086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:26.689539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:26.689966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:26.719591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1a52ed3-6db0-4e61-9527-632e1368b0c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044836 Sep 11 05:37:26.720153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 502/996] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:27.199134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:27.199743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:27.207165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.207647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.208110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.208800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.209254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.209675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.270697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:27.278236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e47ddc6-1b60-4578-ba24-60b7b7e4f2b4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082924 Sep 11 05:37:27.278792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 495/997] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:27 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:27.491533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:27.493656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:27.499963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.501060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.501775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.502466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.502919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.503343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.534296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49616a12-4a3b-40b9-9796-dac922deb041 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Sep 11 05:37:27.534889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 503/998] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:27.732445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:27.734611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:27.740514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.740995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.741429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.742164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:27.742569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:27.742989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:27.772378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf6e0e62-5563-450b-a19f-95fa88b5f65d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044060 Sep 11 05:37:27.772915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 496/999] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:28.301346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:28.301957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:28.308213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.308697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.309130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.309816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.310267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.310719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.373797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:28.382307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40811cd7-d7f3-446e-aa6b-8a225d43e457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085062 Sep 11 05:37:28.382865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 504/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:28 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:28.546928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:28.549169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:28.555572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.556102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.556548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.557241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.557703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.558135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.589446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501019c7-a1a7-4d4b-a2e4-6cc817a01bdd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Sep 11 05:37:28.589996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 497/1001] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:28.785190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:28.787390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:28.793963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.794454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.794899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.795604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:28.796102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:28.796535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:28.830095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f262f37d-ef24-41b5-b53d-f1306d673b43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048875 Sep 11 05:37:28.830657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 505/1002] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:29.406207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:29.407415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:29.413423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.413911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.414349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.415036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.415494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.415919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.477126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:29.484789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba7aaeb8-04f6-473e-90b0-1627e517433b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082591 Sep 11 05:37:29.485339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 498/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:29 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:29.602058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:29.604254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:29.610109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.610672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.611111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.611805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.612281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.612706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.642109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d75ed730-129a-4c5b-9e1b-032b60cdeb36 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Sep 11 05:37:29.642659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 506/1004] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:29.842913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:29.845112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:29.851060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.851554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.852044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.852740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:29.853201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:29.853633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:29.882952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3d1e9e0-ff73-4bee-827f-575fad7e013d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044120 Sep 11 05:37:29.883497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 499/1005] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:30.507368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:30.507972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:30.514113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.514595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.515032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.515719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.516305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.516754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.580256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:30.587889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6fab26c-eae3-4173-a876-7b05a69a7750 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084599 Sep 11 05:37:30.588623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 507/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:30 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:30.654424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:30.657198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:30.663700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.664223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.664671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.665363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.665818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.666242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.695622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4babb96b-fffa-4756-b410-aaa47651b2de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Sep 11 05:37:30.696197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 500/1007] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:30.895519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:30.897730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:30.903633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.904146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.904590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.905281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:30.905741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:30.906172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:30.936414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f42dec9-013c-463d-a9b1-6603b0953047 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045470 Sep 11 05:37:30.936972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 508/1008] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:31.611218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:31.612130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:31.618419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.618909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.619351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.620071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.620535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.620965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.681534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:31.690269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d081453a-053d-4903-9f8d-50b4f8cbd8dc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083769 Sep 11 05:37:31.690815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 501/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:31 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:31.708354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:31.710534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:31.716850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.717327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.717762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.718445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.718893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.719558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.721965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:31.749733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5709bb77-4187-4a44-a420-cd281c8b48c6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Sep 11 05:37:31.750956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 509/1010] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:31.949241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:31.951639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:31.958588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.959069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.959505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.960239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:31.960679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:31.961095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:31.990758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9667b1f-32bd-43d9-a9a4-78d5c92be546 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045675 Sep 11 05:37:31.991315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 502/1011] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:32.712777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:32.713384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:32.720338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:32.720817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:32.721251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:32.721933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:32.722387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:32.722809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:32.763173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:32.765419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:32.772154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:32.772647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:32.773088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:32.773796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:32.774253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:32.774690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:32.785442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:32.794367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab9aac6c-47e8-4665-8952-5e8612f77ad3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085561 Sep 11 05:37:32.795138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 510/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:32.809775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6395571-51e7-4467-afa4-d467f4d38987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050817 Sep 11 05:37:32.810332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 503/1013] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:33.003300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:33.005475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:33.011531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.012019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.012471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.013154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.013610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.014032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.043624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49bc40d3-0a53-44e6-86a4-67653c757012 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044739 Sep 11 05:37:33.044190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 511/1014] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:33.816959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:33.817577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:33.823404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:33.824793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.825280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.825672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:33.825774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.826396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.826848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.827273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.832289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.832808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.833250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.833958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:33.834413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:33.834839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:33.865108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6cd8f00-bf3c-43de-ab68-2b692bcefe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046181 Sep 11 05:37:33.865684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 512/1015] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:33.893050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:33.900790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-114ab474-b7e1-43d0-8b9e-3b42fc653011 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087699 Sep 11 05:37:33.901349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 504/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:33 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:34.056953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:34.059007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:34.065213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.065700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.066146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.066849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.067306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.067738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.096607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f5f3b61-f9ec-486a-b005-bd4fcc9aed77 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043826 Sep 11 05:37:34.097160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 513/1017] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:34.878167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:34.880385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:34.887131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.887557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.888006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.888710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.889165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.889593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.918530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-427da379-e631-43bd-9317-5577af0a6932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Sep 11 05:37:34.919717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 505/1018] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:34.924325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:34.924947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:34.931440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.931933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.932410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.933116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:34.933576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:34.934007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:34.995178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:35.003361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b8bd0fb-1bb1-4d6b-8939-86c91b74c55d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083163 Sep 11 05:37:35.003929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 514/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:34 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:35.108671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:35.110874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:35.116784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:35.117271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:35.117731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:35.118424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:35.118882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:35.119311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:35.149331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57273a70-2358-4b1e-a2c0-6ceaa9963b51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044542 Sep 11 05:37:35.149800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 506/1020] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:35.931041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:35.933252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:35.939827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:35.940347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:35.940783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:35.941472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:35.941924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:35.942344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:35.972468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f4d16b91-9582-4da9-912c-0d149b37676f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Sep 11 05:37:35.973036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 515/1021] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:36.026830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:36.027624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:36.034854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.035347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.035791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.036543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.037010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.037477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.099439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:36.107661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cca4ee8d-c26f-4abf-9341-55e683e3ca76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084879 Sep 11 05:37:36.108289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 507/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:36 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:36.161680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:36.163842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:36.169753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.170236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.170677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.171377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.171835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.172901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.202014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d1f8c03-5259-4ae5-8f26-5b06867657c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Sep 11 05:37:36.202567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 516/1023] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:36.985760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:36.987828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:36.993836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.994327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.994775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.995476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:36.995939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:36.996400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:36.999941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:37.025590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab2b110f-5ebd-4c98-bce4-df775cdecd03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Sep 11 05:37:37.026134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 508/1024] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:37.131242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:37.131846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:37.138598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:37.139073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:37.139514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:37.140225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:37.140722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:37.141184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:37.202039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:37.210086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5143cbc7-e0ab-4007-8669-30f6ec22437a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082710 Sep 11 05:37:37.210804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 517/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:37 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:37.214446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:37.216672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:37.223638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:37.224169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:37.224615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:37.225308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:37.225766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:37.226193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:37.256273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4507fb30-b52f-4f3e-bdbd-24eafe6376bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045622 Sep 11 05:37:37.256753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 509/1026] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:38.038119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:38.040323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:38.046213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.046693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.047144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.047912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.048400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.048827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.077619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07b62838-e53b-4118-aacd-6af3356ea246 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Sep 11 05:37:38.078898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 518/1027] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:38.233561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:38.234176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:38.240686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.241179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.241617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.242310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.242766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.243194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.269496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:38.271656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:38.278006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.278492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.278932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.279630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:38.280121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:38.280549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:38.306339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:38.314453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ba0a6a8-d024-445f-8ced-11cd0cff87ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049349 Sep 11 05:37:38.314815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c1e7518-59e5-4eb4-ac3f-b7e0d078e599 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085116 Sep 11 05:37:38.315019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 519/1028] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:38.315372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 510/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:38 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:39.090097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:39.092266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:39.098871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.099347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.099788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.100483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.100935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.101357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.129743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-273e4e88-2191-4609-b1da-3acc21954d63 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Sep 11 05:37:39.130291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 520/1030] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:39.326871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:39.329202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:39.335682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.336204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.336642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.337343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.337691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:39.338115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.338213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.338314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:39.345443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.345864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.346298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.347021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:39.347476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:39.347899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:39.368879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-565757db-a5da-491e-9493-bddf13e4c9da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045859 Sep 11 05:37:39.369516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 511/1031] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:39.413126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:39.420814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f95de564-d6ff-4ee2-bd03-93708ac80531 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086887 Sep 11 05:37:39.421386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 521/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:39 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:40.143279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:40.145517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:40.151392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.151875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.152343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.153029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.153503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.153908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.183348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3eb36cb-fb1f-4153-85a1-c914477e3d4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Sep 11 05:37:40.183893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 512/1033] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:40.382144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:40.384365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:40.391036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.391690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.392159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.392858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.393364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.393745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.423440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2838efc-1699-4749-9aeb-f0f6934f45c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045369 Sep 11 05:37:40.423989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 522/1034] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:40.444068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:40.444691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:40.451560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.452026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.452739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.454213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:40.454441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:40.454870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:40.517513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:40.525203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b7f3fbe-3164-45c7-b448-89e4dd17c92a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084993 Sep 11 05:37:40.525761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 513/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:40 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:41.194875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:41.197067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:41.202898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.204052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.204526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.205207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.205653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.206072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.235078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e24a28e-36be-4b72-b7e5-adbedfc6b5ed tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Sep 11 05:37:41.235549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 523/1036] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:41.436148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:41.438498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:41.444404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.445013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.445307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.445994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.446445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.446865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.476931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0f3cc8c-f7e0-4657-b74b-7b7556219048 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Sep 11 05:37:41.477466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 514/1037] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:41.548131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:41.548689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:41.555096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.555584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.556057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.556760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:41.557224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:41.557656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:41.618718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:41.626892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-241cdfbf-e81c-45be-992b-5fbba33d49d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083027 Sep 11 05:37:41.627453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 524/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:41 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:42.247143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:42.249425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:42.256051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.256537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.256975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.257668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.258125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.258551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.287826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce397a80-cd51-4b06-865b-0fd60cd2a4f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Sep 11 05:37:42.288398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 515/1039] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:42.490603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:42.492890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:42.498878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.499299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.499732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.500748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.501205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.501632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.528677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:42.535015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9778f401-a96a-4f1c-9ca8-379453664d45 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048653 Sep 11 05:37:42.535577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 525/1040] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:42.650849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:42.651473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:42.658096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.658666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.659127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.659952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:42.660458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:42.660894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:42.727987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:42.736431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-825d65e0-e1db-48bc-9451-44ca9b379e8e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.089650 Sep 11 05:37:42.736998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 516/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:42 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:43.300901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:43.303125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:43.309726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.310208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.310647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.311344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.311800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.312256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.340364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fdf7b193-b967-4f81-8796-3b98c8d58071 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Sep 11 05:37:43.340915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 526/1042] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:43.547416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:43.549621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:43.555609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.556072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.556516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.557204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.557656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.558081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.587158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8516fe2e-d25a-480a-bf45-e12b0e419e34 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043862 Sep 11 05:37:43.587696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 517/1043] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:43.759605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:43.760247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:43.767183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.767659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.768126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.768809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:43.769257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:43.769676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:43.831561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:43.839243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfa4d34c-5e6f-477b-a14e-7066f3b6269c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083566 Sep 11 05:37:43.839808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 527/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:43 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:44.353478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:44.355678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:44.362790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.363280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.363721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.364453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.364916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.365348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.395174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fd8f32f-0ca2-4873-af53-df5c00d3dba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Sep 11 05:37:44.395718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 518/1045] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:44.599545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:44.601738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:44.608088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.608517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.608951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.610290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.610765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.611184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.640324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-908be801-32ec-489f-ac5c-d297c23ad8b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044803 Sep 11 05:37:44.641500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 528/1046] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:37:44.862285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:44.862915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:44.868812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.869290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.869755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.870437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:44.870889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:44.871308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:44.934300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:44.942714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db7b1140-5ac5-4ff9-95d9-1112816ffd7d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084608 Sep 11 05:37:44.943302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 519/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:44 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:45.408544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:45.410750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:45.416633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.417109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.417543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:45.418230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.418681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.419103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:45.449253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ca6e068-593e-4b2e-8ae0-74ddf3d6c24f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Sep 11 05:37:45.449792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 529/1048] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:45.653149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:45.655329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:45.662067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.662497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.662935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:45.663635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.664124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.664557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:45.694460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa743fb7-6f21-4018-a5a1-d1ebf1c6607c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045355 Sep 11 05:37:45.695013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 520/1049] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:45.966157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:45.966727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:45.973118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.973606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.974051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:45.974749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:45.975208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:45.975637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:46.040514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:46.048389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d97c6df8-deec-491b-a3cc-a74aafb5d1f6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086215 Sep 11 05:37:46.048964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 530/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:45 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:46.462026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:46.464202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:46.470861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:46.471340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:46.471778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:46.472490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:46.472942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:46.473360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:46.502982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9208a73d-e641-41b0-b8ab-17406050c9d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Sep 11 05:37:46.503694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 521/1051] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:46.706918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:46.709125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:46.715167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:46.715596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:46.716070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:46.716770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:46.717233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:46.717663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:46.746728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83d06098-1f9c-473d-95aa-696dd516aa0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044266 Sep 11 05:37:46.747281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 531/1052] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:47.071673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:47.072318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:47.078979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.079464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.079906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.080662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.081126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.081558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.142862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:47.150591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50a01eac-09e7-4dd2-929e-47d3c811b907 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082826 Sep 11 05:37:47.151148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 522/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:47 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:47.516245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:47.518364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:47.524693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.525171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.525605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.526286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.526737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.527157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.556206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76181924-0134-47bd-b4cf-3c28f731b088 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Sep 11 05:37:47.556754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 532/1054] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:47.759499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:47.761965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:47.768161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.768594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.769028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.769728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:47.770184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:47.770610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:47.800800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0f3a848-52fd-46e4-a9d3-72cef5fbd388 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045255 Sep 11 05:37:47.801364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 523/1055] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:48.173717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:48.174326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:48.180227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.180712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.181151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.181836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.182294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.182712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.247166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:48.255740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7914ca77-3fe4-4949-ac3c-cca640909bcc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086446 Sep 11 05:37:48.256336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 533/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:48 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:48.568919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:48.571056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:48.577339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.577831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.578543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.579284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.579739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.580201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.605176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:48.611395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65f379de-43f8-42b6-ae0b-2c94ba43929a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Sep 11 05:37:48.611944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 524/1057] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:48 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:48.813237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:48.815420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:48.821927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.822410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.822846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.823539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:48.824028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:48.824444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:48.854478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c40de2e4-2424-41b3-bdcd-45eee561d9aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Sep 11 05:37:48.855031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 534/1058] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:49.278680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:49.279324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:49.285493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.285982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.286422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.287122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.287584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.288039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.349848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:49.357596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68c7ea5b-6778-4638-88a6-d61ad8ce3c8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082978 Sep 11 05:37:49.358153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 525/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:49 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:49.623870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:49.626091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:49.631978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.632484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.632927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.633619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.634070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.635169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.666836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-776ea689-29cd-4cd6-ad8e-f72d41724f39 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047007 Sep 11 05:37:49.667395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 535/1060] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:49.866959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:49.869137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:49.876480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.876907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.877342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.878038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:49.878490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:49.878915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:49.909016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a22c16f-c9cc-4bdc-a9ee-2893a4b87107 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046184 Sep 11 05:37:49.909564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 526/1061] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:50.380721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:50.381328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:50.387887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.388398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.388830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.389520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.389970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.391012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.453422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:50.462381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-10c1d816-3b97-4f41-9665-6509911ae53b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085357 Sep 11 05:37:50.463119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 536/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:50 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:50.678899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:50.681119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:50.687629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.688154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.688594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.689289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.689747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.690176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.720464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bf07e8f-bd3e-43c2-a638-315865d99a4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Sep 11 05:37:50.721015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 527/1063] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:50.922193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:50.924433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:50.931343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.931826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.932295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.933006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:50.933465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:50.933890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:50.965233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ab965d3-ad50-4aba-b82e-568684deb921 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047625 Sep 11 05:37:50.965830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 537/1064] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:51.487048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:51.487589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:51.494154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.494645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.495119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:51.495823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.496306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.496734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:51.569848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:51.577472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26d4a167-d57e-4e12-9e0d-d7ea8ea93639 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.095277 Sep 11 05:37:51.592208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 528/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:51 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:51.732946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:51.735487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:51.743276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.743712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.744182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:51.744903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.745354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.745774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:51.780792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8c7e3fa-0f23-43c6-8e12-7f3af77dd16c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051746 Sep 11 05:37:51.781437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 538/1066] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:51.978014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:51.980208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:51.986295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.986779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.987216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:51.987907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:51.988397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:51.988841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:52.017968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a50ffb11-9030-4c54-8eeb-bf39117a4171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Sep 11 05:37:52.018480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 529/1067] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:52.600104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:52.600715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:52.606635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:52.607116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:52.607551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:52.608272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:52.608726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:52.609655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:52.672835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:52.680561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf6d7665-565b-453f-aeac-cb4d4861da65 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084296 Sep 11 05:37:52.681129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 539/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:52 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:52.794334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:52.796544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:52.803754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:52.804278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:52.804719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:52.805422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:52.805875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:52.806304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:52.835882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cb231ad-c781-41ba-a634-994e56583410 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Sep 11 05:37:52.836469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 530/1069] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:53.030546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:53.033537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:53.035837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=90 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:53.040795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.041281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.041724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.042422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.042879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.043304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.073270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75e71197-0f5f-4293-9d47-582a6d5d3743 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046786 Sep 11 05:37:53.073822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 540/1070] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:53.703733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:53.704386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:53.710932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.711419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.711853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.712576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.713032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.713460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.774034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:53.781660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9eaceb8-d8c8-437b-8c70-da74d556d74c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081893 Sep 11 05:37:53.782260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 531/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:53 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:53.848708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:53.850836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:53.856765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.857237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.857666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.858346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:53.858791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:53.859210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:53.888824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3423d750-3e9c-404d-8850-c7973535c480 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 11 05:37:53.889370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 541/1072] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:54.085753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:54.087921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:54.094309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.094855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.095290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.096012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.096476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.096910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.126707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c274069b-8a4e-444b-a2e1-4b9e38eabf7e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044952 Sep 11 05:37:54.127251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 532/1073] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:54.804479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:54.805089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:54.811446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.811928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.812394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.813149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.813609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.814048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.829567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:54.875988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:54.883655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d40f846-1340-47eb-8cdf-d57ee4d8be4b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083067 Sep 11 05:37:54.884251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 542/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:54 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:54.901838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:54.903938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:54.910738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.911226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.911672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.912402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:54.912863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:54.913294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:54.942757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba0e444d-71b6-41ac-8e34-d7b2d5f6dd68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Sep 11 05:37:54.943313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 533/1075] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:55.139467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:55.142275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:55.148176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.148659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.149108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.149799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.150254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.150679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.179339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60877c45-c98c-40c9-a72d-d260b0c1a9ea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044097 Sep 11 05:37:55.179821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 543/1076] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:55.907195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:55.908031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:55.910136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:37:55.915631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.916146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.916591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.917387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.917745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.918172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.954686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:55.956873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:55.963154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.963631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.964088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.964788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:55.965236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:55.965656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:55.983267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:55.991833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8baee8af-211a-4823-ab97-ba3b0010f9c2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.089021 Sep 11 05:37:55.992429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 534/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:55 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:55.996289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca158065-d8ed-4bf0-86d3-9ac65e38efde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Sep 11 05:37:55.996843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 544/1078] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:37:56.192051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:56.194263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:56.200168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:56.200660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:56.201096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:56.201794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:56.202278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:56.202707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:56.232229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e456de7-efba-4a26-b80a-8b3820da536d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 Sep 11 05:37:56.232786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 535/1079] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:57.008830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:57.011202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:57.015136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:57.015747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:57.017622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.018109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.018554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.019257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.019711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.020175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.022747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.023225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.023664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.024384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.024844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.025265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.050049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fd04c9b-09ac-42f0-bdf1-cde1860c5b4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Sep 11 05:37:57.050614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 545/1080] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:57.088057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:57.095816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b6aaa9f-4f2a-48a7-9a45-d290996a56cc tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084713 Sep 11 05:37:57.096401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 536/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:57 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:37:57.245336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:57.247542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:57.254163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.254640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.255082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.255779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:57.256282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:57.256717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:57.286031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9384ef94-8305-422b-8625-f8cf6145365e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Sep 11 05:37:57.286526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 546/1082] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:58.062393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:58.065187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:58.071629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.072142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.072601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.073382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.073844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.074269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.107295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d11cf15-ce85-4cfe-93f9-c15452e50c87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048932 Sep 11 05:37:58.107851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 537/1083] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:58.118475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:58.119095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:58.125939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.126569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.127036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.127726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.128262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.128688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.192977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:58.200759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-583b9ce3-897a-4366-b1d9-54f12c5cff31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086082 Sep 11 05:37:58.201318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 547/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:58 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:58.298390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:58.300615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:58.306471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.306949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.307380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.308093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:58.308737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:58.309174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:58.338788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8dcdc66e-73ac-4fe4-8cf6-3dbb68cbf22b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Sep 11 05:37:58.339342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 538/1085] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:37:59.120976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:59.123194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:59.130972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.131463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.131909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.132643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.133103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.133535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.169883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51a7fe9f-3c45-4c5c-9671-d4f27a3e2326 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052928 Sep 11 05:37:59.170454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 548/1086] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:37:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:37:59.228450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:59.229063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:59.235125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.235794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.236272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.237032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.237655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.238091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.317923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:37:59.325808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68aed8c4-e065-4897-9cea-0043a0ce7386 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.101816 Sep 11 05:37:59.326377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 539/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:37:59 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:37:59.352136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:37:59.354287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:37:59.360359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.360845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.361279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.361980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:37:59.362437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:37:59.362863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:37:59.400943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3f5d13c-17d2-440e-8c43-e00796c95b91 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052658 Sep 11 05:37:59.401433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 549/1088] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:37:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:00.181497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:00.183680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:00.190280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.190754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.191182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.191862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.192343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.192761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.221555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e10c5feb-affb-42ee-9341-da0beb5688eb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Sep 11 05:38:00.222112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 540/1089] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:00.350310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:00.350921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:00.356881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.357364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.357811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.358509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.358961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.359386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.414196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:00.416395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:00.420676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:00.423690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.424336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.424781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.425568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:00.425948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:00.426558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:00.429522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c1752c98-f98d-4025-a0f6-053da037d555 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083084 Sep 11 05:38:00.430541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 550/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:00 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:00.443284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:00.460719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc0cfab6-f51b-4d87-b5c7-7f819e4faf21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050481 Sep 11 05:38:00.461313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 541/1091] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:01.233605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:01.235959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:01.241918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.242402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.242843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.243538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.244020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.244449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.274344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60fc6f70-81f4-43d3-bc62-a92c8ca82fcb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Sep 11 05:38:01.274890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 551/1092] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:01.455260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:01.455872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:01.462218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.462700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.463174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.463860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.464349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.464778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.473387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:01.475566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:01.481969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.482453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.482897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.483594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:01.484134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:01.484551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:01.515989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f75a4349-8057-4f0f-9063-e531c94ddf14 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046638 Sep 11 05:38:01.516898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 552/1093] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:01.527776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:01.535916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db9e9589-7553-47e0-af9f-08e432c3ba1f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085787 Sep 11 05:38:01.536530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 542/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:01 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:02.286934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:02.289126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:02.295009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.295482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.295916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.296617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.297069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.298182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.327379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1faefe45-de9a-4736-8985-12807bf96166 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 11 05:38:02.327915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 553/1095] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:02.528973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:02.531122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:02.538316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.538735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.539169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.539854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.540332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.540755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.558884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:02.559491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:02.566731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.567223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.567662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.568390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:02.568848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:02.569273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:02.571898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8802fe9-2173-4d0c-b66d-6d48433bd049 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046867 Sep 11 05:38:02.572550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 543/1096] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:02.630119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:02.637964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-54c67354-98c8-41f8-9097-ac429cb189d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082978 Sep 11 05:38:02.638524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 554/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:02 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:03.339785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:03.341993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:03.348497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.348986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.349427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.350125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.350582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.351021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.380697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d44ec128-8a7b-45ad-b355-f95b40072b7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Sep 11 05:38:03.381248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 544/1098] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:03.584568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:03.586766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:03.593173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.593649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.594649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.595339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.595794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.596251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.625093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4662bb21-5103-4f8f-9b3c-e4c31ba0b399 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Sep 11 05:38:03.625841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 555/1099] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:03.662097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:03.662715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:03.669190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.669674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.670110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.670804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:03.671263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:03.671718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:03.735516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:03.743191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56f8f33c-43e4-4509-9a1f-d57f8623f591 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084916 Sep 11 05:38:03.743750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 545/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:03 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:04.393771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:04.395920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:04.401885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.402360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.402794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.403585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.404066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.404493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.433959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2427b65b-777d-48af-94ba-949c1e4b4530 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Sep 11 05:38:04.434509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 556/1101] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:04.637993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:04.640172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:04.646255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.646682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.647117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.647809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.648288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.648717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.679377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ff29367-63ea-4587-9233-ec26be993cca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045692 Sep 11 05:38:04.680018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 546/1102] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:04.766396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:04.767003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:04.773424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.773902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.774337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.775032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:04.775509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:04.775911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:04.837364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:04.845532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-711a5b48-8306-4824-a16e-c6f25984d932 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083043 Sep 11 05:38:04.846100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 557/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:05.447166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:05.449447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:05.456796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.457283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.457720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.458416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.458873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.459300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.488863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f9aaf28-8634-4a23-867c-ec6d85d963a9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Sep 11 05:38:05.489417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 547/1104] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:05.692392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:05.694529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:05.700541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.700963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.701399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.702089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.702545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.702970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.731682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e96b495-a78c-445b-b0f7-28966c9b4b37 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043837 Sep 11 05:38:05.732264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 558/1105] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:05.868632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:05.869246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:05.876285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.876768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.877204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.877893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:05.878348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:05.878773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:05.940357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:05.947973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8135459-42d7-4397-8007-237f58f032bf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083202 Sep 11 05:38:05.948552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 548/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:05 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:06.501220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:06.503454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:06.509860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.510345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.510792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:06.511741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.512235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.512669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:06.516323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:06.543480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-140cbbf9-39b5-40d3-8ef5-1809c7fded03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046473 Sep 11 05:38:06.544062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 559/1107] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:06.744034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:06.746334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:06.752806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.753228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.753662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:06.754346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.754793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.755213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:06.785492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16849154-d3ce-498c-90ed-efdff19aaeda tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Sep 11 05:38:06.786037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 549/1108] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:06.971514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:06.972162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:06.978050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.978529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.978966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:06.979658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:06.980142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:06.980570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:07.045046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:07.052894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9798a2fd-b2ca-4142-9c86-9748e69b5288 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086086 Sep 11 05:38:07.053452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 560/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:06 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:07.557173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:07.559352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:07.566776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:07.567265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:07.567713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:07.568497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:07.568955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:07.569409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:07.599011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c32f33d3-c47c-4e0b-a1a5-9da5ef3f8250 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046114 Sep 11 05:38:07.599605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 550/1110] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:07.798922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:07.801114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:07.807548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:07.808065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:07.808505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:07.809207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:07.809662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:07.810088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:07.838781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d830f069-979d-4a81-9a6d-431bc8f0ad95 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Sep 11 05:38:07.839341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 561/1111] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:08.077259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:08.077882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:08.084091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.084653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.085169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.085945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.086487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.086984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.149527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:08.158159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4106d595-c233-4dfc-a212-e4d3a002e5ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085586 Sep 11 05:38:08.158728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 551/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:08 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:08.611604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:08.613807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:08.619712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.620231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.620673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.621363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.621821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.622791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.651457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99acbe2e-1bf6-4904-a626-e7a509394f42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Sep 11 05:38:08.652020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 562/1113] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:08.851730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:08.853946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:08.861177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.861705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.862093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.862783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:08.863231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:08.863676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:08.893522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65f720a6-fa4e-452a-9161-e177dc2ccb9b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046006 Sep 11 05:38:08.894068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 552/1114] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:09.180253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:09.180812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:09.187171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.187708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.188487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.189231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.189683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.190105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.250976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:09.258694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6726fd90-f8a3-44c0-ad54-979f9b7af3d3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082486 Sep 11 05:38:09.259245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 563/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:09 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:09.663751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:09.665936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:09.671848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.672532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.672992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.673687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.674143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.674571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.690888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:38:09.691062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:38:09.706488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f72cc835-fe70-4592-886f-4c38c47daa72 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046737 Sep 11 05:38:09.707043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 553/1116] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:09.905946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:09.908739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:09.914681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.915107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.915548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.916269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:09.916733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:09.917164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:09.946296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82081f05-9175-465e-b2cc-9f8b70a40957 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044405 Sep 11 05:38:09.946855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 564/1117] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:10.282715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:10.283263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:10.289925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.290418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.290861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:10.291570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.292056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.292597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:10.359107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:10.368593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fd0feaa-83d2-41e7-aa6c-fccc33a5d6ad tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.090423 Sep 11 05:38:10.369171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 554/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:10 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:10.719426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:10.721914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:10.728434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.728922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.729358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:10.730052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.730505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.730928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:10.760786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb560819-3321-4f80-8876-a6dc502d0a8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 11 05:38:10.761594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 565/1119] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:10.959370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:10.961525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:10.970188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.970990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.971798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:10.972912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:10.973673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:10.974324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:11.009455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fe008e4-774f-4645-8f6b-70671440268a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054207 Sep 11 05:38:11.010487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 555/1120] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:11.393114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:11.393723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:11.399601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:11.400124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:11.400564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:11.401273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:11.401710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:11.402136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:11.463056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:11.471347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed149a4d-a5ab-494c-9aa1-3cc0349c48f7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082772 Sep 11 05:38:11.471908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 566/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:11 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:11.774360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:11.776601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:11.783690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:11.784207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:11.784654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:11.785370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:11.785843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:11.786278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:11.818018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a49fe730-0d67-4e32-b8ca-c0ffb30f8047 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048291 Sep 11 05:38:11.818581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 556/1122] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:12.025663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:12.027735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:12.035905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.036413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.036849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.037538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.037987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.038405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.067341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a407d7e7-c535-4956-b8d4-2ec80c1039be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045781 Sep 11 05:38:12.067897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 567/1123] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:12.493958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:12.494577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:12.501022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.501504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.501942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.502635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.503091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.503519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.568707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:12.576481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15929ed2-d6ed-488e-858a-a90c390141d5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086387 Sep 11 05:38:12.577042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 557/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:12 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:12.831311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:12.833499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:12.839589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.840090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.840526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.841215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:12.841665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:12.842087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:12.873314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc14903b-35b1-4dfd-a5b6-433cd861eeab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Sep 11 05:38:12.873884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 568/1125] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:13.080217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:13.082369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:13.088701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.089180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.089612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.090300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.090750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.091172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.093505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:13.122228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af002473-7fdf-4729-bd30-69a3efa5f44f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046381 Sep 11 05:38:13.122777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 558/1126] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:13.600430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:13.601047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:13.607347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.607824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.608302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.608996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.609617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.610051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.674826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:13.682633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-235a0cf9-c028-430c-bece-e6ab0679610e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086125 Sep 11 05:38:13.683201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 569/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:13 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:13.886789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:13.888936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:13.895840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.896349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.896783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.897467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:13.897916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:13.898334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:13.927112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4316f5f6-fd88-4ca6-aee9-1ea65ba567ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Sep 11 05:38:13.927658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 559/1128] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:14.134784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:14.137248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:14.144136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.144616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.145047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.145730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.146177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.146597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.175805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34bf1e57-00b9-4cba-b87e-c15dee2f32cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045004 Sep 11 05:38:14.176376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 570/1129] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:14.705369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:14.706021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:14.712557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.713161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.713608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.714308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.714767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.715198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.778285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:14.786524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04c3a301-90ed-4af5-89fe-542a4a6718ba tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085194 Sep 11 05:38:14.787090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 560/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:14 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:14.939723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:14.942144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:14.948591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.949065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.949504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.950195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:14.950644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:14.951062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:14.980965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9647cebe-b3cb-425f-96c4-d16620401703 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Sep 11 05:38:14.981522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 571/1131] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:15.188518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:15.190719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:15.196579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:15.197074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:15.197488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:15.198172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:15.198619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:15.199040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:15.228846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86352add-8bfa-40d3-940e-5e412eae0043 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044570 Sep 11 05:38:15.229387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 561/1132] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:15.809895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:15.810507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:15.817200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:15.817678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:15.818113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:15.818802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:15.819256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:15.819681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:15.883143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:15.891189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5fce940-d7bc-4de4-ab52-9fffdca3469d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085180 Sep 11 05:38:15.891751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 572/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:15 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:15.993753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:15.995892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:16.003147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.003629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.004089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.004777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.005229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.005653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.037586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b141b753-fd54-45a6-b2a6-9b5d34085873 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Sep 11 05:38:16.038175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 562/1134] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:16.241730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:16.243879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:16.250267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.250947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.251415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.252139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.252591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.253013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.282601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9faaf91d-e487-46f6-93a7-0bcc9966dbe1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044744 Sep 11 05:38:16.283170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 573/1135] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:16.913599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:16.914138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:16.916131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:38:16.916274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:38:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 (ip 10.222.0.33) !!! Sep 11 05:38:16.922726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.923204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.923639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.924358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:16.924813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:16.925233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:16.986636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:16.994220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3ef02fc-578e-4b5c-85cc-611f7dab5097 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084642 Sep 11 05:38:16.994776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 563/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:16 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:17.050133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:17.052336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:17.061428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:17.062839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:17.063606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:17.064566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:17.065033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:17.065464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:17.094604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b0e3562-8801-4a3f-a987-71b3d3603377 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Sep 11 05:38:17.095155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 574/1137] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:17.295203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:17.297981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:17.304420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:17.304902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:17.305337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:17.306028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:17.306477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:17.306900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:17.336488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23d99793-ee25-49cc-be53-eb0057ec0934 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045268 Sep 11 05:38:17.337039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 564/1138] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:18.018180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:18.018799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:18.025578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.026062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.026504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.027202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.027665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.028140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.090501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:18.092760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:18.100380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4423fbfe-5487-4a45-bbc7-a08c669583dd tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086716 Sep 11 05:38:18.100956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 575/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:18 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:18.107175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:18.109656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:18.115695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.116227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.116667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.117361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.117861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.118248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.147888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59812695-c854-455c-8d8b-563986c19818 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Sep 11 05:38:18.148469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 565/1140] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:18.349133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:18.351281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:18.357167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.357644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.358081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.358771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:18.359260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:18.359698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:18.389155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d86c3f7b-a1b2-48d7-94f4-fda3f981fa50 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044111 Sep 11 05:38:18.389712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 576/1141] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:19.123566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:19.124215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:19.130746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.131229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.131671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.132384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.132845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.133275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.161873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:19.164104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:19.170638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.171152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.171591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.173004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.173461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.173883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.197927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:19.203653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bc1e23e9-8762-40b3-8c58-38cf108ce8e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047318 Sep 11 05:38:19.204258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 577/1142] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:19.205871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95ed9564-f32a-4e12-806d-64333908c360 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086179 Sep 11 05:38:19.206424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 566/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:19 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:19.402299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:19.404444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:19.411008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.411495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.411940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.412661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:19.413121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:19.413546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:19.445553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-892bf384-5492-4153-a84d-ca28cf6be895 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046984 Sep 11 05:38:19.446509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 578/1144] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:20.216384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:20.218569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:20.225262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.225743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.226177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.226881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.227336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.227753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.229202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:20.229819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:20.236325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.236808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.237251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.237947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.238401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.238828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.258504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a60dcfaa-11f4-4105-822e-2a905519cb24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Sep 11 05:38:20.259056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 567/1145] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:20.301121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:20.308763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9cb41687-804d-4c0f-a395-3c2c6b04c7d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083569 Sep 11 05:38:20.309318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 579/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:20 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:20.458907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:20.461134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:20.467200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.467632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.468109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.469582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:20.469582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:20.470191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:20.499557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6f141b1-426e-42ab-b9ef-7e2f1c2e73be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044742 Sep 11 05:38:20.500718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 568/1147] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:21.272018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:21.274165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:21.280583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.281100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.281652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.282352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.282811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.283243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.311445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2be84e55-2923-42b3-9c07-e5e861cd32fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Sep 11 05:38:21.312024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 580/1148] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:21.332508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:21.333125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:21.339391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.339872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.340343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.341032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.341485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.341909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.405901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:21.413954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc0464ee-dba0-494d-a647-647acfd44cb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085881 Sep 11 05:38:21.414513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 569/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:21 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:21.512915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:21.515106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:21.521623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.522155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.522558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.523248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:21.523702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:21.524163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:21.552990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aab0164d-49e7-4817-8d22-1da520be541e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044337 Sep 11 05:38:21.553539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 581/1150] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:22.324777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:22.326935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:22.333557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.334150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.334450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.335139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.335587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.336036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.366554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8e5ffa7-3ff1-490f-b552-f7875ac15810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Sep 11 05:38:22.367095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 570/1151] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:22.436519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:22.437176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:22.443818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.444341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.444786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.445485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.445946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.446376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.509150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:22.517820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-769c8d25-b592-4e65-aaa9-dd06ef8fc7fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085161 Sep 11 05:38:22.518390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 582/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:22 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:22.565605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:22.567788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:22.573664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.574143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.574575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.575318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:22.575709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:22.576173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:22.606665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bdb3754-af46-4fa7-9786-cda72a07bf4f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045287 Sep 11 05:38:22.607202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 571/1153] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:23.379100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:23.381264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:23.383089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=86 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:23.388730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.389216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.389649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.390405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.391037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.391567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.420010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31f4a5a8-27d4-4583-91c5-29efe40f8b54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Sep 11 05:38:23.420558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 583/1154] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:23.541088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:23.541741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:23.548871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.549365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.549810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.550508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.550970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.551401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.612347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:23.618901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:23.620326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e2553e3-a725-4aaf-a01e-9d5bf27b8f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083056 Sep 11 05:38:23.620904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 572/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:23 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:23.621095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:23.627546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.628051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.628491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.629237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:23.629635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:23.630055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:23.659455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f45a6318-dff6-4d54-85b1-f2b45e518b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Sep 11 05:38:23.660021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 584/1156] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:24.432536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:24.434718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:24.441320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.441799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.442233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.442916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.443363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.443780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.473728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4af3e748-9aaa-47fe-9bdd-69abd95702aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Sep 11 05:38:24.474288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 573/1157] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:24.644632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:24.645240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:24.651708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.652221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.652657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.653348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.653803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.654228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.671454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:24.674343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:24.680745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.681233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.681674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.682376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:24.682887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:24.683265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:24.709890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:24.715200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-663125c4-cdd5-4ace-a72a-65f7bd0f9ee9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047747 Sep 11 05:38:24.715766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 574/1158] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:24.719960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:24.727706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49401033-f684-4b80-b94f-681d07257e8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087555 Sep 11 05:38:24.728288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 585/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:24 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:25.486835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:25.489100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:25.495046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.495605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.496081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.496780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.497228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.497648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.529498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2310a0b-c2bb-4b76-b5b1-a6b98c435ab1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Sep 11 05:38:25.530066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 575/1160] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:25.728062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:25.730115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:25.736768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.737244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.737674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.738359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.738807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.739232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.751794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:25.752810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:25.759023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.759539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.759974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.760696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:25.761412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:25.761835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:25.769926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-55a8cc9a-14a4-49e1-b626-92c5b8b1889b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045906 Sep 11 05:38:25.770857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 586/1161] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:25.824725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:25.833279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce3c20c8-9e5c-482c-be41-16bb0c8fedb5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086533 Sep 11 05:38:25.833847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 576/1162] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:25 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:26.543094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:26.545288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:26.551534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.552030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.552473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.553163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.553623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.554034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.583031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e1a0006-d625-43eb-a26f-b302d15f3155 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Sep 11 05:38:26.583569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 587/1163] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:26.782715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:26.785009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:26.787376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:26.792993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.793570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.793954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.794654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.795110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.795538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.825947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82e0ee9e-6147-49b9-ade0-a05732fe407c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047374 Sep 11 05:38:26.826509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 577/1164] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:26.855785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:26.856424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:26.862828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.863302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.863731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.864455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:26.864904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:26.865324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:26.928802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:26.936498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db067623-88de-4676-83af-82417109ff03 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084608 Sep 11 05:38:26.937111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 588/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:26 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:27.594986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:27.597200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:27.603070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.603549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.603983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.604693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.605143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.605568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.635888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d659044-9a89-4386-89be-fccb36b0c30d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Sep 11 05:38:27.636872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 578/1166] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:27.763390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-343518781"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:38:27.763922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:27.769838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.770347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.770780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.771475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.771929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.772379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.838859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:27.841084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:27.847864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.848325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.848767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.849473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.849931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.850372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.881651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f460a8d4-2a46-40f7-b0d0-6b3d45f71554 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046712 Sep 11 05:38:27.882793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 579/1167] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:27.898471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.network.security_group_api [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Removing security group 5586fbb7-953c-4c67-a651-7ff244058860 from port d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb Sep 11 05:38:27.960095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:27.960716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:27.966635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.967122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.967565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:27.968354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:27.968813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:27.969238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.033390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:28.041065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b2db4e5-2573-45a9-89ef-c24c4dea1a2d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084842 Sep 11 05:38:28.041942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 580/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:27 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:28.210311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86f1c933-9dd3-441d-ba3d-ac3e0d4fa9d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action" status: 202 len: 0 microversion: 2.1 time: 0.451094 Sep 11 05:38:28.210958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 589/1169] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:38:27 2022] POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:38:28.219945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:38:28.229473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:28.229952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:28.230386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.244426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] Creating event network-changed:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:38:28.249353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-11eeece1-69e1-4479-b657-f213ab9dc0bc req-8fc68349-1ef4-4af5-be02-d5f91a2e16c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Sep 11 05:38:28.250650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 581/1170] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:28.650783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:28.653428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:28.669700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:28.671143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:28.673430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.675867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:28.679045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:28.679585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.722430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-65b26825-e23e-413b-ab36-0fd60e5f2e7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076640 Sep 11 05:38:28.727034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 590/1171] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:28.896282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:28.898665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:28.905150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:28.905629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:28.906821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.907667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:28.908280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:28.908704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:28.942205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7f64bb2-e5cd-4d14-9157-cd79e0214116 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050729 Sep 11 05:38:28.942667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 582/1172] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:38:29.064508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:29.065138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:29.071427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.071917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.072431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.073166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.073627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.074056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.145548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:29.153115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d402089-e52b-466a-aa3b-8ce3f4920527 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.093184 Sep 11 05:38:29.153747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 591/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:29 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:38:29.591988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:29.592517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:29.599262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.599838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.600461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.601237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.601772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.602273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.735662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:29.737963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:29.744052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.744549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.744993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.745701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.746157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.746589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.771193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:29.776396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f34fcb4-fc23-4dd9-a51c-2cf83210e6ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Sep 11 05:38:29.776964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 592/1174] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:29.955286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:29.957532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:29.963452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.963938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.964420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.965126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:29.965585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:29.966015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:29.995921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-919f63a4-16b8-463e-aa41-fb3a9e72a904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045485 Sep 11 05:38:29.996509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 593/1175] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:30.177629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:30.178392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:30.184997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:30.185477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:30.185911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:30.186599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:30.187722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:30.188269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:30.247817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:30.256128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dbe9fbc0-4df5-40ce-a05d-3676ad49f4b6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082902 Sep 11 05:38:30.256899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 594/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:30 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:30.272970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:38:30.282912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:30.283392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:30.283823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:30.295327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] Creating event network-changed:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 05:38:30.301224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-cf27d926-8fa0-4496-93cb-6d7e290c47d5 req-6723f0f7-e262-4cf5-8923-519e45c485aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031909 Sep 11 05:38:30.302232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 595/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:30.790347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:30.792629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:30.799026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:30.799510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:30.799953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:30.800723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:30.801187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:30.801615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:30.832402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56b18015-4bc1-4915-ae9e-b648c0a23a24 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Sep 11 05:38:30.832982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 596/1178] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:31.009039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:31.011357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:31.018624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.019104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.019541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.020250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.020704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.021130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.050546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-275af5a7-1223-4cad-9653-e520337c24a1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045624 Sep 11 05:38:31.051101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 597/1179] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:31.279181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:31.279811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:31.285813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.286299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.286744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.287439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.287904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.288356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.349949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:31.357800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e742fbf-9ec8-4114-b156-7a551595ab1a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082517 Sep 11 05:38:31.358361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 598/1180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:31 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:31.845799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:31.847986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:31.853919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.854407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.854845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.855534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:31.855985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:31.856434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:31.885685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6bf1de7-447d-4319-a56f-75032dd1bbde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Sep 11 05:38:31.886507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 599/1181] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:32.063417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:32.065528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:32.071803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.072320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.072755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.073444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.073894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.074318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.103625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6cf7124-17f6-4c64-8821-c71e46840c92 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044522 Sep 11 05:38:32.104194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 600/1182] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:32.380146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:32.380799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:32.386850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.387333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.387772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.388502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.388961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.389391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.451583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:32.460330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9d8b16d3-b73a-4a1c-8c34-236dd0569d84 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084021 Sep 11 05:38:32.460898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 601/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:32.898203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:32.900435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:32.906439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.906927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.907399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.908136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:32.908601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:32.909031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:32.939185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa6cb2fe-0fc8-4321-baaf-4e83b084dcd5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Sep 11 05:38:32.939674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 602/1184] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:33.116797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:33.118953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:33.125519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.126664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.127278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.127981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.128508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.128964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.159205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92c5d161-0c6c-472d-b5ec-239294b38c4b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046278 Sep 11 05:38:33.159756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 603/1185] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:33.483338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:33.484015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:33.490738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.491223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.491686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.492414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.492869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.493326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.553583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:33.561223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93f33d60-09c3-4241-bb25-e100297c4330 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081676 Sep 11 05:38:33.561790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 604/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:33 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:33.950765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:33.952983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:33.959712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.960199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.960636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.961321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:33.961773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:33.962192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:33.991539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4002e572-b933-4a70-a01c-420d4729e642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Sep 11 05:38:33.992102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 605/1187] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:34.171560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:34.173743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:34.180092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:34.180597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:34.181018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:34.181716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:34.182175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:34.182604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:34.216112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce769dac-b2b2-428c-85c0-69d1d2afd964 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048472 Sep 11 05:38:34.216673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 606/1188] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:34.583576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:34.584271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:34.590020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:34.590496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:34.590932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:34.591613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:34.592092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:34.592521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:34.653205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:34.660978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7bcf767-bf6a-47a5-86f6-06f80e779751 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081594 Sep 11 05:38:34.661540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 607/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:34 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:35.004139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:35.006256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:35.012506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.012988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.013426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.014111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.014567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.014989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.043845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58718927-42e9-437b-a6c1-cc90daca9995 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Sep 11 05:38:35.044410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 608/1190] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:35.228509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:35.230651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:35.236956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.237434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.237866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.238551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.239002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.239426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.268706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0dd24f0d-fcec-4f93-8034-d5a2375a7598 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044033 Sep 11 05:38:35.269192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 609/1191] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:35.683434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:35.684095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:35.691106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.691588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.692057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.692752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:35.693201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:35.693651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:35.696350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:35.755392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:35.763216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7face159-6be9-4844-857d-ceffa6035ef3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083653 Sep 11 05:38:35.763793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 610/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:35 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:36.056952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:36.059010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:36.065798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.066274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.066705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.067391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.067839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.068287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.096863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fba106f3-004c-4216-a9c4-ca5ce040c9f4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Sep 11 05:38:36.097397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 611/1193] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:36.280797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:36.283697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:36.289868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.290340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.290770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.291451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.291897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.292338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.321693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-988fe6e5-f993-4428-a7aa-e6a83e07d728 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044647 Sep 11 05:38:36.322235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 612/1194] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:36.786913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:36.787566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:36.793558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.794044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.794477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.795170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:36.795620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:36.796069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:36.859510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:36.867494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-727dd5ab-10cb-4af1-a88d-e3f08b44fac7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085199 Sep 11 05:38:36.868076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 613/1195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:36 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:37.109235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:37.111701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:37.117645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.118129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.118574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.119297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.119756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.120211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.150371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c7a6e33-238c-4760-b2dc-ad1d1ad861ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Sep 11 05:38:37.150913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 614/1196] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:37.334644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:37.336811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:37.343018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.343489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.343917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.344785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.345538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.345963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.375132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9af089c-610e-4524-8dcb-d76830087090 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044303 Sep 11 05:38:37.375617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 615/1197] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:37.890429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:37.891049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:37.897196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.897688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.898127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.898819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:37.899274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:37.899700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:37.959720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:37.967624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb79fc12-6200-4c86-a64f-0e21de7eb92e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081334 Sep 11 05:38:37.968277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 616/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:37 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:38.163351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:38.165552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:38.171585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.172094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:38.172532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:38.173536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.173995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:38.174416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:38.202838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a966974d-f4fe-4dce-9d07-dd4bf4bd0b2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Sep 11 05:38:38.203380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 617/1199] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:38.388306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:38.390376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:38.397331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.397819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:38.398263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:38.398959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.399415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:38.399844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:38.429927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e3756a9-33cb-4956-aee7-f63afd66784a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045920 Sep 11 05:38:38.430484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 618/1200] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:38.991494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:38.992133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:38.997926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.998403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:38.998834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:38.999517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:38.999966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:39.000417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:39.060841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:39.069269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-047c5ced-abf6-4e87-8873-f54a58195f16 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081801 Sep 11 05:38:39.069824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 619/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:38 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:39.215962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:39.218205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:39.224624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:39.225104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:39.225545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:39.226237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:39.226694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:39.227124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:39.256200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd98859e-9d05-422a-a3df-e74723458033 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Sep 11 05:38:39.256686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 620/1202] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:39.442748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:39.444906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:39.451217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:39.451701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:39.452178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:39.452872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:39.453328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:39.453795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:39.483725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cacfced0-e963-4df9-849c-9195ed5c5650 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Sep 11 05:38:39.484317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 621/1203] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:39.596401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=13 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:39.621925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=49 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:40.091829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:40.092475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:40.098506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.098993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.099434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.100165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.100623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.101052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.161791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:40.169497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6dde51db-191c-4fef-9288-a99575fea5f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081614 Sep 11 05:38:40.170060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 622/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:40 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:40.268938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:40.271117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:40.276870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.277355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.277796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.278495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.278952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.279382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.307810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b774e11-d7ba-42d1-aec4-3a36c5af36aa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Sep 11 05:38:40.308385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 623/1205] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:40.496245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:40.498391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:40.505415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.505891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.506324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.507011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:40.507463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:40.507885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:40.537736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48e5d5aa-b931-4eba-be0e-b1052f0c32c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045574 Sep 11 05:38:40.538292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 624/1206] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:41.192468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:41.193145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:41.199231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.199720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.200204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.200901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.201356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.201787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.264493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:41.272680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a58bdb4-425a-4499-8d93-b357ca22d79d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084081 Sep 11 05:38:41.273240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 625/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:41 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:41.319704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:41.321857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:41.327442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.327919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.328416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.330945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.331410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.331837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.356539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:41.361821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6cd37bf-8d72-4490-a055-620291e32471 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Sep 11 05:38:41.362373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 626/1208] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:38:41.550903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:41.552991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:41.559204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.559679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.560143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.560827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:41.561274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:41.561693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:41.591753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99c961ec-c184-4d77-8ea0-454016af129f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045526 Sep 11 05:38:41.592324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 627/1209] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:42.295759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:42.296447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:42.303097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.303574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.304021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.304713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.305165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.305581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.366233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:42.373819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1762475e-2c2d-4a28-9572-386a3150f283 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081942 Sep 11 05:38:42.374376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 628/1210] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:42 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:42.379104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:42.381240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:42.387080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.387561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.388013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.388707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.389160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.389581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.418562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-52be5356-4346-4d38-9d9b-cf43318d947e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Sep 11 05:38:42.419104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 629/1211] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:42.604620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:42.606835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:42.614352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.614834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.615272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.615974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:42.616449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:42.616868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:42.648397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a4910ccf-ff4c-48fe-b28d-f6232edd1333 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047766 Sep 11 05:38:42.648959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 630/1212] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:43.396984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:43.397683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:43.403557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.404056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.404494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.405179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.405628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.406084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.466620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:43.474525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5da1421-bcc6-4053-9448-98c56f50614a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081473 Sep 11 05:38:43.475090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 631/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:43 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:43.479529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:43.481643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:43.488027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.488520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.488954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.489636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.490085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.490500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.520350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9aae539-4b41-43b1-a68b-df8cef2d55ca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Sep 11 05:38:43.520888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 632/1214] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:43.660733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:43.662818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:43.665058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:43.670401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.670880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.671318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.672021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:43.673061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:43.673669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:43.702762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb782a34-02e6-4bfa-804d-46745352df04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046306 Sep 11 05:38:43.703315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 633/1215] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:38:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:38:44.497656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:44.498309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:44.506539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.507034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.507464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.508196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.508814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.509217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.575481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:38:44.583469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e0a72a9-3a13-4237-a8e6-a06efdba1a3b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.089625 Sep 11 05:38:44.584052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 634/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:38:44 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:38:44.588646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:44.590759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:44.597103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.597611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.598045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.598731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.599185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.599599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.629492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db73cf01-68c3-47f7-95c5-931cd43e8439 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Sep 11 05:38:44.630045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 635/1217] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:38:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:38:44.692673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:38:44.693160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:38:44.699629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.700148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.700583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.701266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:38:44.701714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:38:44.702236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:38:44.787984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lazy-loading 'services' on Instance uuid e812967c-7475-468f-a1c8-433fef2f929c {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:38:54.697271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=7 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:54.722123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=59 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:38:54.792537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:03.625236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:39:03.671653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f880bd8a-4fec-47ea-82ea-5cc4fdba32c8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments/5470d0e4-70e1-40c0-b38d-9b9becf69c4a" status: 202 len: 0 microversion: 2.1 time: 34.083372 Sep 11 05:39:03.672534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 583/1218] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:38:29 2022] DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments/5470d0e4-70e1-40c0-b38d-9b9becf69c4a => generated 0 bytes in 34085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:39:03.680261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:03.682601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:03.690854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.691353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.691863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.693250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.693706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.694143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.725996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0981bd6-75c2-41cb-af35-7de252d83375 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052261 Sep 11 05:39:03.726595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 584/1219] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:03.732175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:03.732175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:03.739244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.739746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.740228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.740945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.741408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.741841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.805989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:03.813681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39fda08f-2156-446c-9474-f44a124a4652 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086174 Sep 11 05:39:03.814937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 585/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:03 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:39:03.819585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:03.822014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:03.827538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.828039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.828480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.829173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.829694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.830390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.859160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3aef560-2333-42ac-981f-cf6f2ae98d49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Sep 11 05:39:03.859706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 586/1221] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:03.866762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:03.868894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:03.874373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.874851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.875282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.875962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:03.876443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:03.877417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:03.905827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f359fdc-6788-42ec-8741-b72202113600 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Sep 11 05:39:03.906373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 587/1222] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:04.743315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:04.745520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:04.752661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.753313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.753752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.754441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.754890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.755311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.785341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f670983-0b95-410c-871a-9d251e23fd0b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046041 Sep 11 05:39:04.785891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 588/1223] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:04.836844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:04.837456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:04.843301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.843782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.844251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.844943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.845469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.846210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.907028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:04.914836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c44507d8-b208-416d-be2e-8abfb83f3489 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081841 Sep 11 05:39:04.915388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 589/1224] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:04.920031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:04.922162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:04.927936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.928446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.928882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.929569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.930019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.930439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.961951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85edd520-1f76-47c7-884a-e751e97edf26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Sep 11 05:39:04.962423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 590/1225] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:04.966896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:04.969008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:04.974955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.975429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.975861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:04.976576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:04.977024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:04.977447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:05.006714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e94133ef-dcff-4c63-8647-9304668bef4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Sep 11 05:39:05.007272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 591/1226] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:05.797858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:05.800649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:05.807050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:05.807538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:05.807974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:05.808698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:05.809152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:05.809582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:05.838860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce99051f-84a5-4f22-8932-90952272fad9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045018 Sep 11 05:39:05.839408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 592/1227] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:05.937749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:05.938368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:05.944282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:05.944763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:05.945201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:05.945891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:05.946346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:05.946770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.010039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:06.018532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1f95dac-ec82-4363-b3a0-7f76e12a3950 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084561 Sep 11 05:39:06.019295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 593/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:05 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:06.023917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:06.026061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:06.032038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.032539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.033715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.034311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.034810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.035219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.067622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45854276-e090-400f-ae6a-f15f8140dea2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Sep 11 05:39:06.068216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 594/1229] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:06.072659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:06.074760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:06.080793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.081292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.081729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.082424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.082884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.083312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.111656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7edd37b4-2f0e-4e45-88ee-b5fb36efe82c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Sep 11 05:39:06.112186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 595/1230] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:06.852879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:06.855024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:06.861629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.862137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.862575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.863285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:06.863735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:06.864190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:06.894122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-651981d7-a898-48db-a38b-28c731ed4e83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Sep 11 05:39:06.894663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 596/1231] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:07.041649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:07.042188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:07.048147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.048642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.049080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.049772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.050229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.050657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.110445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:07.118163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53877f29-b174-40d7-85f6-08bb5c0c12ef tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.080475 Sep 11 05:39:07.118916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 597/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:07 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:07.123199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:07.125370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:07.131878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.132517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.132961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.133652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.134102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.134523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.164497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97637044-804e-4d2e-a821-6a13edf303a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Sep 11 05:39:07.165040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 598/1233] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:07.169406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:07.171460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:07.176951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.177427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.177855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.178533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.178981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.179403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.208009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffae1ee1-1c93-4705-8e1c-3b1dde35b826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Sep 11 05:39:07.208560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 599/1234] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:07.906714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:07.909442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:07.915735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.916244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.916682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.917521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:07.917987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:07.918411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:07.922148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:07.949522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5974fe1-2af0-4136-87a5-2da04e49a3ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046834 Sep 11 05:39:07.950067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 600/1235] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:08.141551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:08.142165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:08.148604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.149124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.149559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.150246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.150818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.151258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.211782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:08.219812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efa54b5b-a7af-4258-a8af-3c275bee7372 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082374 Sep 11 05:39:08.220493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 601/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:08 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:08.225973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:08.228123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:08.233722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.234295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.234731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.235419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.235866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.236322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.265378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00eb7d52-3ffa-4b02-8fda-92550bceace1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Sep 11 05:39:08.265918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 602/1237] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:08.270999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:08.273092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:08.278446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.278925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.279357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.280061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.280519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.280939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.309435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05df85f1-51f9-4ed5-aa3a-397ac7e04a98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Sep 11 05:39:08.309974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 603/1238] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:08.962216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:08.964350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:08.970726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.971485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.972095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:08.972793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:08.973245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:08.973667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.004086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1fbfb1e-183f-40fb-8401-284e6a2b2510 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045967 Sep 11 05:39:09.004658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 604/1239] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:09.243536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:09.244105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:09.249958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.250449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.250897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.251593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.252141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.252576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.314509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:09.322413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7edc48e-ad67-4def-8031-c02be4e69457 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082701 Sep 11 05:39:09.322979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 605/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:09 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:09.327619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:09.329850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:09.335554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.336069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.336506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.337188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.337638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.338057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.368912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-428c5cae-6360-4327-9958-b30623960bb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Sep 11 05:39:09.369456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 606/1241] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:09.373838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:09.375903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:09.381668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.382146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.382598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.383258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:09.383712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:09.384169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:09.413211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c001b7b9-46ee-4300-824f-d74e02961be9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042806 Sep 11 05:39:09.413742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 607/1242] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:10.016635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:10.019487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:10.025892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.026386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.026832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.027532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.028018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.028446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.061979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa587d5f-9fef-44f6-bdf0-1c08abaa7f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049202 Sep 11 05:39:10.062467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 608/1243] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:10.345286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:10.345901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:10.351914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.352428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.352863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.353550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.354003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.354429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.417995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:10.426237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24e241df-5559-48a3-af8f-aba73582a908 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084836 Sep 11 05:39:10.426791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 609/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:10 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:10.431820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:10.434021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:10.440780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.441240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.441694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.442397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.442858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.443308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.473526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9ee9544-4edf-4eae-937d-9b1c166a7148 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Sep 11 05:39:10.474078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 610/1245] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:10.478484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:10.480597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:10.485926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.486910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.487544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.488393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:10.488847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:10.489266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:10.517788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa62e8f9-d4d9-4921-99c3-e5d9f37d7e4e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Sep 11 05:39:10.518481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 611/1246] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:11.075231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:11.077442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:11.084336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.084814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.085244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.085927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.086426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.086846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.116342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0283700a-d7c0-4e94-9e78-724e0eeb03dd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045185 Sep 11 05:39:11.116890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 612/1247] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:11.450099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:11.450714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:11.457251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.457757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.458210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.458947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.459454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.459881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.520133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:11.528080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fbbe9fb-9a73-4b50-ba38-ca06b4793b50 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081760 Sep 11 05:39:11.528644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 613/1248] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:11 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:11.533221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:11.535409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:11.541007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.541812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.542253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.542944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.543398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.543822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.572977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1530ef12-bbca-4148-be6e-8f2b33c41923 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Sep 11 05:39:11.573531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 614/1249] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:11.640459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:11.643313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:11.649227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.649716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.650153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.650844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:11.651296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:11.651725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:11.680912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95f60ac7-91c6-4f46-b629-b375dfb67b46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106413 Sep 11 05:39:11.681459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 615/1250] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:12.129028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:12.131177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:12.137845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.138324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.138756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.139441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.139892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.140337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.166197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:12.171397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43e56d43-273a-4514-becf-c4eafcc6b746 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046720 Sep 11 05:39:12.171945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 616/1251] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:12.551640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:12.552295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:12.558342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.558825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.559266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.559962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.560444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.560872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.622413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:12.631400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe0eaef3-7724-4bd0-9dfe-1b4c4bc7cb06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084333 Sep 11 05:39:12.631980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 617/1252] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:12 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:12.637085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:12.639255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:12.645721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.646212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.646653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.647356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.647816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.648270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.678435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5990b03f-3924-4ac4-b816-e0a781a50438 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Sep 11 05:39:12.678985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 618/1253] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:12.693263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:12.695406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:12.701132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.701621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.702062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.702757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:12.703215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:12.703648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:12.733610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac07f249-2abb-4a7e-ab8d-eabea4b25e45 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Sep 11 05:39:12.734151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 619/1254] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:39:13.185344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:13.187526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:13.193965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.194455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.194894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.195593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.196067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.196497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.225820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-652266f2-93eb-4460-9b88-6b808f7dccf3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045428 Sep 11 05:39:13.226364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 620/1255] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:13.631625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:13.654687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:13.655298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:13.662024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.662512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.662947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.663643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.664130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.664561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.724811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:13.732470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f65d8ae5-2994-483b-9ec9-fcc7b482cd09 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081597 Sep 11 05:39:13.733026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 621/1256] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:13 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:13.737542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:13.739675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:13.746153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.746674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.747142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.747842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.748411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.748857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.779234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6d23e61-2307-4d09-9217-29f454632987 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Sep 11 05:39:13.779789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 622/1257] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:13.784277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:13.786379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:13.791870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.792388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.792833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.793538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:13.793991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:13.794418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:13.823510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-341ef355-5e5b-4054-8ab0-f386baf12a7c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Sep 11 05:39:13.824086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 623/1258] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:14.238810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:14.241009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:14.247429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.247913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.248390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.249080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.249569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.249995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.279446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67018593-c8d9-43eb-896d-8afe4238c913 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045058 Sep 11 05:39:14.280008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 624/1259] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:14.755131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:14.755750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:14.762324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.762808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.763249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.763972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.764455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.764885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.828181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:14.836613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d42c844-2eb2-4962-b3ca-ca284bd52780 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085483 Sep 11 05:39:14.837176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 625/1260] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:14 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:14.841713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:14.843843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:14.850143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.850627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.851062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.851753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.852231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.852655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.881014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c92e4781-c7b4-4ae9-9105-dcc799e70772 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042854 Sep 11 05:39:14.881559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 626/1261] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:14.885945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:14.888307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:14.894307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.894789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.895227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.895910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:14.896395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:14.896821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:14.925473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a45a7df9-7ac8-4d79-807e-322b4746cb73 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Sep 11 05:39:14.926016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 627/1262] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:15.291941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:15.294102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:15.301144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.301622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.302058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.302748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.303197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.303618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.334084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-210e02bb-9285-443d-a5d0-ea88c582ba79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046323 Sep 11 05:39:15.334631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 628/1263] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:15.859304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:15.859925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:15.866423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.866918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.867359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.868086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.868546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.868976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.930257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:15.938563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c95a4694-0200-40b2-ac94-b16b9031d1be tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083072 Sep 11 05:39:15.939156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 629/1264] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:15 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:15.943924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:15.946122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:15.951814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.952341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.952781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.953474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.953931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.954362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.983585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0095ee30-de12-4807-8994-53df8d0d578a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Sep 11 05:39:15.984155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 630/1265] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:15.989362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:15.991441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:15.996896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.997377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.997814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:15.998500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:15.998954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:15.999388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:16.027229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6584fce-cca5-4f7e-ab93-462aa8eb5afd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Sep 11 05:39:16.027987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 631/1266] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:16.347442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:16.349613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:16.355928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:16.356445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:16.356882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:16.357574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:16.358025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:16.358451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:16.387501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80f8984b-b769-4d4e-9a03-f8923bdf7e84 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044662 Sep 11 05:39:16.388061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 632/1267] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:16.961963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:16.962498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:16.965398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:16.969335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:16.969815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:16.970245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:16.971166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:16.971726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:16.972189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:16.989885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:17.034099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:17.041801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5c46756-06dc-479b-ac0b-ef84dd815ba6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083789 Sep 11 05:39:17.042361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 633/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:16 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:17.046866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:17.049685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:17.055342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.055819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.056283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.056993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.057440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.057860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.087647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fea1eb87-d371-4393-81f6-c94bd51dd653 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Sep 11 05:39:17.088216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 634/1269] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:17.092564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:17.094621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:17.100479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.100956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.101387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.102064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.102511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.102932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.132213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e75a1a4-7e72-4edd-8b79-05211a0e4613 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Sep 11 05:39:17.132753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 635/1270] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:17.400082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:17.402336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:17.409235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.409713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.410150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.410853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:17.411309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:17.411734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:17.441134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b35eab9-c276-468d-bf4d-376173ad9968 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045071 Sep 11 05:39:17.441679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 636/1271] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:18.064788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:18.065414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:18.071281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.071767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.072242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.072936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.073389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.073815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.135977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:18.145699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d13d167b-c604-4ed9-9d06-4327e2fd5eaf tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084771 Sep 11 05:39:18.146264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 637/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:18 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:18.150943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:18.153133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:18.159661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.160183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.160616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.161369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.161819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.162260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.191605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ac6b0c1-2d47-44f1-a02c-d9909346fe4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Sep 11 05:39:18.192194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 638/1273] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:18.196598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:18.198670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:18.204098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.204584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.205570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.206275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.206725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.207149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.234662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cb7edd2-dcd1-4cd1-9713-2ea71b45d826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Sep 11 05:39:18.235204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 639/1274] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:18.453866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:18.456656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:18.463343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.463833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.464309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.465007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:18.465466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:18.465896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:18.494701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6eb2a45c-654f-4d4a-a3db-de79abb87884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044983 Sep 11 05:39:18.495261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 640/1275] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:19.170234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:19.170861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:19.177481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.177974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.178416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.179114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.179581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.180034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.243389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:19.251089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ba895bd-80b5-404f-a1b2-2b98b9ad9483 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084743 Sep 11 05:39:19.251646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 641/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:19 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:19.256261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:19.258390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:19.264244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.264723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.265155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.265855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.266303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.266721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.296730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73ea6856-d1b9-444f-987d-cfc70e9528da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Sep 11 05:39:19.297280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 642/1277] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:19.302669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:19.304771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:19.313433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.314360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.315168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.316237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.316967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.317409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.346568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80c0d956-254c-4d4c-beeb-5b4ddd59cacf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047666 Sep 11 05:39:19.347125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 643/1278] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:19.507265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:19.509365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:19.515884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.516399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.516838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.518047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:19.518547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:19.518931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:19.547850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0cdf468-2c95-428d-92cf-ce6a0ee34ed9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044569 Sep 11 05:39:19.548417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 644/1279] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:20.274112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:20.274763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:20.280767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.281230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.281664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.282353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.282809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.283356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.343402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:20.351148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eda3e567-7ec8-4f81-8e5a-ed2d11847e5f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.081008 Sep 11 05:39:20.351708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 645/1280] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:20 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:20.356252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:20.358373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:20.364439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.364919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.365356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.366055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.366507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.366934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.396319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5b3f3e1-592d-496e-80f0-b17f08964fe3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Sep 11 05:39:20.396866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 646/1281] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:20.401271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:20.403342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:20.409200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.409683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.410117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.410803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.411256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.411681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.441074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72e77586-df34-4747-8439-ad227e725164 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Sep 11 05:39:20.441859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 647/1282] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:20.560236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:20.562311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:20.568745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.569233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.569676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.570381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:20.570837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:20.571267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:20.600463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3599c2a-cb9a-480a-b8fe-2692a725266e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044370 Sep 11 05:39:20.601013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 648/1283] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:21.373832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:21.374444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:21.380529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.381006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.381438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.382119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.382566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.382988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.445619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:21.453366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55b61a5f-a067-4959-9e97-be4a042482c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083380 Sep 11 05:39:21.453923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 649/1284] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:21 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:21.458619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:21.460892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:21.466462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.466944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.467379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.468106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.468558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.468984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.473559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:21.499704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18ebdf59-09da-4473-9099-6e600fc9dd67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Sep 11 05:39:21.500281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 650/1285] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:21.504954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:21.507039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:21.512814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.513296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.513732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.514426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.514878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.515305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.543716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89f39f98-9b6b-4086-9661-086120303b2a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Sep 11 05:39:21.544292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 651/1286] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:21.612678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:21.614801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:21.620999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.621502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.621942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.622630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:21.623085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:21.623507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:21.654635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75ff8f59-94a1-4952-9e37-e28e1dba2b60 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045737 Sep 11 05:39:21.655160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 652/1287] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:22.476331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:22.476956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:22.482863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.483351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.483791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.484517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.484981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.485413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.545710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:22.554448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c0295ef-98f5-441b-81ce-40e2436266d6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082078 Sep 11 05:39:22.555017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 653/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:22 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:22.559547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:22.561749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:22.568226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.568712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.569152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.569848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.570304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.570733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.600081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f02adaa5-522a-4d32-8c62-21e42ba30fb6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Sep 11 05:39:22.600630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 654/1289] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:22.605038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:22.607118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:22.613379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.613943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.614291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.614984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.615441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.615875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.644879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4bc0e48-c3c0-4a4a-a0d4-159d2d362c15 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 Sep 11 05:39:22.645420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 655/1290] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:22.667900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:22.670027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:22.676728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.677208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.677637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.678315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:22.678767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:22.679186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:22.708068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-647e13dd-6912-471a-88c2-1938a0cdebc5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Sep 11 05:39:22.708605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 656/1291] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:39:23.577722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:23.578345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:23.584574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.585065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.585508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.586205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.586667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.587097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.650238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:23.658096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e28ccb37-efc7-451a-bbb0-b6a95610eb6a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084291 Sep 11 05:39:23.659172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 657/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:23 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:23.663741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:23.665916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:23.671536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.672047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.672493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.673191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.673649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.674075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.703343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec7bcecf-b932-4daf-b233-21444b59545e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Sep 11 05:39:23.703891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 658/1293] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:23.708477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:23.710439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:23.715902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.716422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.716862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.717554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.718012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.718439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.747576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0bf8cfdb-ea96-44d8-9719-6f15b9860214 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Sep 11 05:39:23.748153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 659/1294] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:23.753334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:23.755432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:23.761089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.761836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.762278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.762973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:23.763428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:23.763858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:23.793051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-969e2243-f87c-4435-b0fd-9e005530f8df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043890 Sep 11 05:39:23.793612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 660/1295] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:24.682680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:24.683362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:24.689747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.690233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.690826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.691527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.692449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.692449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.753149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:24.760936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-584a13c4-9a75-40ed-a0d9-3fd5ecc09d53 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082252 Sep 11 05:39:24.761758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 661/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:24 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:24.766250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:24.769014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:24.774480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.774960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.775398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.776112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.776572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.776999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.806765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-774d40d7-5a1c-4d3a-bc38-b18725ad5811 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Sep 11 05:39:24.807332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 662/1297] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:24.811841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:24.813976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:24.819716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.820236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.820674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.821365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.821819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.822245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.851374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47e6d69a-2efe-4c1d-9805-5cb54ed32877 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 Sep 11 05:39:24.851922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 663/1298] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:24.856419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:24.858496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:24.864008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.864501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.864939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.865622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:24.866074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:24.866517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:24.895965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffcbb1b9-91aa-48cf-8642-df1ad05cdc2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 Sep 11 05:39:24.896539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 664/1299] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:25.783186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:25.784440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:25.790823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.791319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.791763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.792502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.792965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.793394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.856636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:25.864982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e342e6e-3789-451a-a5ad-2fdefad3a40d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085665 Sep 11 05:39:25.865545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 665/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:25 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:25.870173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:25.872327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:25.878065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.878556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.878998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.879696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.880187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.880618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.905535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:25.911477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-143bae63-2431-41e2-97cb-ba0400e28370 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Sep 11 05:39:25.912054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 666/1301] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:25.916527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:25.918787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:25.925197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.925821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.926270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.927150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.927608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.928067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.956370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6aa183f1-9229-440b-972d-944574a7caf4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Sep 11 05:39:25.956936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 667/1302] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:25.961475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:25.963570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:25.969054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.969539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.969984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:25.970673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:25.971129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:25.972285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:26.000817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcc1ad63-b83a-4672-985d-d71b0c384735 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042912 Sep 11 05:39:26.001365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 668/1303] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:26.888286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:26.888915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:26.895478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:26.895956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:26.896418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:26.897109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:26.897558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:26.897980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:26.960288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:26.968244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1370e24b-a4ec-403c-9046-7fdc112cfeed tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084115 Sep 11 05:39:26.968806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 669/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:26 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:26.973728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:26.975956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:26.981705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:26.982196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:26.982655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:26.983346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:26.983795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:26.984259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.013855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61b21999-2e21-4b86-923f-5452454d2564 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Sep 11 05:39:27.014402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 670/1305] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:27.018868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:27.020964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:27.026302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.026780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:27.027213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.027893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.028369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:27.028794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.057274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef1f89db-5b67-4092-a7d1-05ec6f7f323e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041921 Sep 11 05:39:27.057814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 671/1306] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:27.062961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:27.065689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:27.071084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.071557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:27.071990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.072696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.073142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:27.073559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.101514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-842d9825-3b90-4f5c-805e-3dfa1d7808ad tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042760 Sep 11 05:39:27.102046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 672/1307] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:27.990584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:27.991264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:27.997773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.998269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:27.998714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:27.999411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:27.999871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.000328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.063540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:28.071798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86d1cb73-6afb-4432-954d-d881403678f5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085084 Sep 11 05:39:28.072389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 673/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:27 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:28.076878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:28.079036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:28.085263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.085753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.086203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.086902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.087364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.087792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.121521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1468cc9e-25f8-4f8d-bfb0-9715eb60abab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Sep 11 05:39:28.122088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 674/1309] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:28.126644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:28.129390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:28.134991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.135478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.135917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.136902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.137387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.137814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.166765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5f14b4e-e254-4cf2-93d7-d7c1f50ea0cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Sep 11 05:39:28.167317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 675/1310] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:28.171721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:28.173809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:28.179308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.179791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.180278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.180966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:28.181416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:28.181842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:28.211321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db6a6df9-d398-4b8f-9b3a-644f1345da0f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043037 Sep 11 05:39:28.211860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 676/1311] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:29.095128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:29.095772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:29.102627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.103120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.103563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.104288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.104746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.105178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.165562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:29.173431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f22c6ed7-db38-4bfe-bf3d-177f9a98dc9c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082192 Sep 11 05:39:29.174000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 677/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:29 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:29.178635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:29.180786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:29.186397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.186879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.187311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.188023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.188475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.188900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.217935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a42ebd83-f152-41f0-86ad-b35a120a0ae7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Sep 11 05:39:29.218515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 678/1313] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:29.223710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:29.225806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:29.231273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.231753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.232232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.232916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.233371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.233802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.261407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8883252c-fce2-459c-afdd-9cac74235d90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Sep 11 05:39:29.262203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 679/1314] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:29.266590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:29.269198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:29.274541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.275017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.275449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.276164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:29.276617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:29.277041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:29.305288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bea80ecc-4c9f-4ec1-abd4-f7fe9b3d39c0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042132 Sep 11 05:39:29.305834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 680/1315] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:30.195768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:30.196450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:30.202769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.203246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.203676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.204392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.204841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.205261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.266325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:30.274181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e404d9a-dfef-456b-b8f5-3e8efe5303b3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082258 Sep 11 05:39:30.274733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 681/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:30 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:30.279177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:30.281317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:30.287527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.288124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.288558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.289240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.289689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.290106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.319362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fda1f4e7-d40a-42f4-89d9-b71d46009c7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Sep 11 05:39:30.319901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 682/1317] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:30.324273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:30.326345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:30.328871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:30.332914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.333393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.333825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.334507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.334952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.335372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.352245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:30.366111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-659068a3-eb96-4dba-8873-db3d5e658010 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Sep 11 05:39:30.366649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 683/1318] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:30.371033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:30.373121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:30.378796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.379275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.379709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.380416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:30.380866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:30.381287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:30.410439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-296d90ae-4fea-4df7-9579-e12266384fa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042833 Sep 11 05:39:30.410974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 684/1319] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:31.297448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:31.298089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:31.305214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.305712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.306158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.306859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.307318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.307747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.371379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:31.379772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50392d4e-1bde-4bcb-96d3-5a14b8307816 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086228 Sep 11 05:39:31.380357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 685/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:31 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:31.385123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:31.387478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:31.393117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.393597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.394023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.394706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.395154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.395576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.424092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88b1f8ff-524f-4f21-b739-fbe6cefcbe83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Sep 11 05:39:31.425167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 686/1321] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:31.429641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:31.431644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:31.437107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.437587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.438019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.438696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.439143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.439563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.469089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7197099-59e1-4d35-b7b0-dfe0004586b1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Sep 11 05:39:31.469649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 687/1322] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:31.474553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:31.476660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:31.482112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.482585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.483016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.483694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:31.484172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:31.484706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:31.513843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2696c73-9442-412b-83c9-50b4784d7d5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043255 Sep 11 05:39:31.514378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 688/1323] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:32.402894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:32.403615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:32.410029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.410541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.410997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.411704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.412193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.412622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.476316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:32.484181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e6a24eb-45d3-4df6-aaa9-e4db5b050025 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085139 Sep 11 05:39:32.484740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 689/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:32.489726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:32.491905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:32.497545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.498031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.498470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.499166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.499626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.500259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.530633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af3a47b1-5d26-454c-baee-99f2d60225e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Sep 11 05:39:32.531179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 690/1325] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:32.535886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:32.537993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:32.543408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.543895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.544369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.545065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.545524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.545955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.574804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2d211b9-8803-42aa-94c9-47d835a1f0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 Sep 11 05:39:32.575351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 691/1326] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:32.579973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:32.582259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:32.587691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.588217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.588658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.589349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:32.589805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:32.590235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:32.619335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c33ff7e-bbb6-45a6-876a-a59ad5a2545b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042935 Sep 11 05:39:32.619878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 692/1327] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:33.506923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:33.507604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:33.514336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.514824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.515255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.515944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.516427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.516853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.577035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:33.585564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56b34e34-ae2c-47f5-9392-b1c51a3a8e76 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082716 Sep 11 05:39:33.586117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 693/1328] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:33 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:33.590631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:33.592763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:33.599380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.599863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.600356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.601051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.601506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.601948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.631850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a3595aa-8bdf-40d4-802d-741b0dde22e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Sep 11 05:39:33.632432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 694/1329] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:33.637147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:33.639274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:33.645235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.645709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.646142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.646827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.647279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.647706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.675889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43730bde-1e59-455a-b2d1-3386758d28ca tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Sep 11 05:39:33.676460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 695/1330] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:33.680962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:33.683022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:33.688472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.688950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.689385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.690105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:33.690557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:33.690990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:33.719471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8f0b200-61c9-49bb-82a6-024632ca3258 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042050 Sep 11 05:39:33.720018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 696/1331] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:34.608802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:34.609460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:34.616538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.617033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.617473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.618172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.618632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.619065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.680493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:34.688256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-928c277e-f77c-4b92-a477-25644e3ad10d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083277 Sep 11 05:39:34.688814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 697/1332] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:34 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:34.693356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:34.696055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:34.701977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.702465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.702907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.703609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.704096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.704529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.733874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca20d18a-a3c4-461c-b6b5-5a37afb642c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 11 05:39:34.734429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 698/1333] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:34.739510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:34.741638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:34.747053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.747538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.747978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.748695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.749154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.749584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.778016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f26ea7b-1b6a-43c9-8679-907042ceaccf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042621 Sep 11 05:39:34.778557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 699/1334] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:34.782951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:34.785692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:34.791421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.791901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.792397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.793094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:34.793554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:34.793974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:34.797737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:34.824574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bd08020-1591-41c7-8d62-a0cab2209d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045016 Sep 11 05:39:34.825124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 700/1335] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:35.711365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:35.712087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:35.718445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.718924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.719355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.720061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.720515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.720971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.782576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:35.790530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff631365-b8a5-4b26-ba0f-e7d897b680da tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083027 Sep 11 05:39:35.791090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 701/1336] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:35 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:35.795792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:35.797931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:35.804423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.805044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.805447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.806241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.806816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.807085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.836986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10bb53eb-cbb4-4c4f-ac8b-04791c8e60ee tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Sep 11 05:39:35.837531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 702/1337] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:35.842075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:35.844208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:35.849800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.850278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.850710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.851386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.851834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.852281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.881396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14fd12c8-c881-4ab4-a0e2-4867271beb44 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Sep 11 05:39:35.881935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 703/1338] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:35.886480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:35.888821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:35.894529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.895007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.895443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.896159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:35.896609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:35.897028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:35.927014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b8f0bd5-7306-4d4d-b113-343b4b961eea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044097 Sep 11 05:39:35.927563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 704/1339] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:36.813836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:36.814457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:36.820973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.821462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.821896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.822594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.823050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.823479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.887836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:36.896268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3747991b-a471-4f7c-bd8d-28c9b435edfb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086307 Sep 11 05:39:36.896854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 705/1340] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:36 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:36.901337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:36.903493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:36.909043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.909524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.909959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.910651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.911110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.911534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.940724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb9ee657-eaca-4e57-a263-e118cf67a570 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Sep 11 05:39:36.941152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 706/1341] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:36.945589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:36.947744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:36.953297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.953782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.954219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.954909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:36.956043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:36.956483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:36.989981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83f491cf-ecef-47a0-8382-493b8b7ce052 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047805 Sep 11 05:39:36.990546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 707/1342] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:36.995019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:36.997149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:37.003225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:37.003685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:37.004185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:37.004883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:37.005342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:37.005769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:37.034882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3abce87-2ab2-47f7-a091-84cce2ba3091 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Sep 11 05:39:37.035424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 708/1343] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:37.919020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:37.919676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:37.926618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:37.927107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:37.927574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:37.928290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:37.928746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:37.929204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:37.989925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:37.997638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d74bab55-8c9f-4115-b15a-df498a4b7963 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082532 Sep 11 05:39:37.998194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 709/1344] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:37 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:38.003033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:38.005186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:38.010784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.011268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.011977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.012691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.013146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.013573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.043736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e6c6127-0c82-4eef-b88d-927798d3690b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Sep 11 05:39:38.044324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 710/1345] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:38.048809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:38.051212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:38.056853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.057280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.057718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.058405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.058856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.059280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.088226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91a5b3e7-58d5-4984-ac95-e81db5cb8ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Sep 11 05:39:38.088767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 711/1346] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:38.093168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:38.095262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:38.101398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.101879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.102325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.103022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:38.103477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:38.103903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:38.133240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58a30f7f-ceab-4ed9-81ec-5275c338d825 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043467 Sep 11 05:39:38.133798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 712/1347] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:39.020784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:39.021392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:39.027676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.028204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.028646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.029339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.029795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.030222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.091626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:39.099909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43455599-8f18-41a7-a145-ce2bb1a33d2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083667 Sep 11 05:39:39.100494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 713/1348] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:39 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:39.104978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:39.107090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:39.112801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.113287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.113722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.114415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.114867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.115294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.144893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcb0e21e-86ee-4b0a-aad8-2d37695ab391 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Sep 11 05:39:39.145438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 714/1349] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:39.149848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:39.151924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:39.157437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.157920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.158421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.159108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.159562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.159990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.187772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-979bb093-bed0-4c5f-9adf-7f7ee622191c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 Sep 11 05:39:39.188358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 715/1350] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:39.193416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:39.195470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:39.200842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.201324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.201761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.202445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:39.202897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:39.203327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:39.232655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:39.239800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a80e3380-676a-4e2d-a620-fc10d5bbe5c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050497 Sep 11 05:39:39.240373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 716/1351] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:40.123227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:40.123837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:40.130177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.130660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.131095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.131775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.132248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.132670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.194757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:40.202520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b881a07b-63f9-43a6-944c-e945f8c7522e tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083745 Sep 11 05:39:40.203082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 717/1352] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:40 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:40.207628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:40.209778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:40.215232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.215715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.216195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.216886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.217339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.217770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.247576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a627af6-7139-4189-a7df-b16837dd4339 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Sep 11 05:39:40.248146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 718/1353] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:40.252753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:40.254818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:40.260289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.260769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.261207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.262190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.262643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.263069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.291818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5c773ac-e07f-43d4-9ed6-96327747588a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Sep 11 05:39:40.292394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 719/1354] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:40.296796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:40.298842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:40.304286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.304765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.305201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.305881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:40.306337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:40.306767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:40.335632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73cde117-018c-4e22-a08a-74268a08b153 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042199 Sep 11 05:39:40.336131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 720/1355] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:41.224061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:41.224753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:41.231009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.231487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.231921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.232634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.233089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.233513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.296890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:41.305228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c013363-5597-411b-b0c6-e4ba670ff00f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085054 Sep 11 05:39:41.305793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 721/1356] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:41 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:41.310266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:41.312401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:41.318501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.318989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.319425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.320143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.320598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.321025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.349463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3840a59a-e93b-44ac-a9b3-1c513dd2c8e5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042680 Sep 11 05:39:41.350022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 722/1357] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:41.356199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:41.359775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:41.367283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.367776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.368246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.368942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.369399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.369825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.403521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be6e2215-d6de-4f38-a66e-bbd3046ef35b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052536 Sep 11 05:39:41.404081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 723/1358] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:41.409082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:41.411268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:41.416758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.417238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.417674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.418359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:41.418811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:41.419236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:41.448394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d838ef62-9713-484d-8a66-08d0ee574a8e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043305 Sep 11 05:39:41.448927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 724/1359] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:42.328444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:42.329114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:42.336237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.336716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.337155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.337842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.338296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.338716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.399738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:42.407547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b989ed68-ddbc-4b10-9ccc-1f2d50a420a1 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082937 Sep 11 05:39:42.408172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 725/1360] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:42 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:42.412998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:42.415108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:42.420698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.421182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.421617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.422308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.422763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.423188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.452678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82d52ebe-079f-4f78-975d-59ce9ffe2ecf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Sep 11 05:39:42.453214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 726/1361] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:42.458219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:42.460718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:42.466555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.467037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.467476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.468201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.468655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.469100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.497888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4799057c-4306-4510-bc0e-9d0bd635b48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Sep 11 05:39:42.498518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 727/1362] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:42.503581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:42.505673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:42.511014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.511495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.512222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.512913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:42.513364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:42.513823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:42.545350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dad3416-c11c-483d-8249-1199449017fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045813 Sep 11 05:39:42.545899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 728/1363] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:43.430555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:43.431247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:43.437720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.438196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.438629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.439312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.439851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.440461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.501075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:43.509050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0901ab1c-98ec-461f-9e41-8b6a81b93a12 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082381 Sep 11 05:39:43.509605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 729/1364] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:43 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:43.514308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:43.516429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:43.522763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.523237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.523673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.524378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.524828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.525246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.554688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f746ce9-affa-4965-a61d-f8f7acd767d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044100 Sep 11 05:39:43.555230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 730/1365] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:43.559599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:43.561687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:43.567500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.567976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.568437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.569109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.569559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.569982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.599215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0b989e6-a360-494b-80ab-6a3b36db3f66 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Sep 11 05:39:43.599752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 731/1366] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:43.604144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:43.606181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:43.611686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.612359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.612795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.613472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:43.613920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:43.614337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:43.643781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c838698-d811-4196-bb6e-e109179c5857 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042172 Sep 11 05:39:43.644402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 732/1367] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:44.532344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:44.533018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:44.536852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:44.540660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.541146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.541587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.542280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.542736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.543164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.561764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:44.606616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:39:44.615446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56dfdad1-15dd-4738-8d5b-9ebf63b90294 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086967 Sep 11 05:39:44.616025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 733/1368] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:39:44 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:39:44.620494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:44.622606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:44.628368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.628855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.629291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.629980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.630432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.630859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.659852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75698902-f7c8-4b40-99d3-fee227fdb443 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 Sep 11 05:39:44.660443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 734/1369] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:44.664877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:44.666966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:44.672416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.672899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.673333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.674630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.675086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.675506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.703582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35e5a1a4-4db4-41e6-bccd-c22810e0c434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Sep 11 05:39:44.704158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 735/1370] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:39:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:39:44.708644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:44.710721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:44.716262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.716744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.717185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.717868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.718320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.718744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.748321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-150b2004-a551-4531-990b-5c268194b93b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043170 Sep 11 05:39:44.748862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 736/1371] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:39:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:39:44.753564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:39:44.754054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:39:44.759372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.759856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.760327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:44.761014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:39:44.761467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:39:44.762157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:39:52.840599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:39:52.841100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:39:54.757227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=8 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:54.779680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=24 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:39:58.023370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:39:58.023891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:40:34.955060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:40:34.956255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:40:44.963547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-70f7374a-a51c-401b-8c5d-d96d0fc6ed9d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 202 len: 0 microversion: 2.1 time: 120.274674 Sep 11 05:40:44.964223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 636/1372] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:38:44 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 0 bytes in 120276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 05:40:44.970179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:40:44.970869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:40:44.978954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:44.980391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:44.980391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:44.981156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:44.981633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:44.982108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.052670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:40:45.062015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-62769d0c-623d-4ee1-ab79-6144b57b0895 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.096474 Sep 11 05:40:45.062577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 637/1373] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:40:44 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:40:45.068243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:40:45.070500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:40:45.076623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.077112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.077542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.078232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.078678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.079098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.109235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-251a609b-8ec9-4610-87b8-63289fab8ef7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Sep 11 05:40:45.109653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 638/1374] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:40:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:40:45.114885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:40:45.117059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:40:45.119638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:40:45.123755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.124273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.124734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.125425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.125880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.126304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.155951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e80e52b4-ba82-48c6-bc74-7d7d28bb0315 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045285 Sep 11 05:40:45.156541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 639/1375] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:40:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:40:45.235957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:40:45.239112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:40:45.244992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.245496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.245927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.246611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.247058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.247475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.277367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7c303b0-d02b-4a67-a5b6-571de7de242c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119838 Sep 11 05:40:45.277907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 640/1376] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:40:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:40:45.282428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:40:45.282972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:40:45.288710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.289183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.289616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:45.290289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:40:45.290736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:40:45.291152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:40:55.134327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:55.286956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:40:55.309907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:03.840246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:41:03.842563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:41:03.844306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:41:03.845269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:41:03.846442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:41:03.847671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:41:03.849192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) Sep 11 05:41:03.850431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:41:03.851517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ef3ad546-41fe-4598-b167-c4d43d79ac3e) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:41:03.851517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab517f3c-224d-4978-bd96-51fef88c26f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 79.093964 Sep 11 05:41:03.851517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 737/1377] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:39:44 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 79095 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 11 05:41:03.851517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:03.851841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:03.857360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.857851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.858297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:03.858996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.859456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.859883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:03.889380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:41:03.925029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:03.933603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2546ea6b-1588-4432-8bb6-9bced8f130ea tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087730 Sep 11 05:41:03.934988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 738/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:03 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:41:03.939313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:03.942923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:03.949187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.949886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.950315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:03.951199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.951661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.952213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:03.982568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05b9d4e8-1f52-48f9-a4a5-92e48d2916e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Sep 11 05:41:03.983177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 739/1379] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:03.987761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:03.990605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:03.996348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.996837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.997275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:03.997980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:03.998441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:03.998876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:04.028933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97aff5a8-2c71-4468-bb57-03a8ca54a20e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Sep 11 05:41:04.029499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 740/1380] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:04.034299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:04.036555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:04.043198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:04.043730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:04.044212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:04.044916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:04.045378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:04.045812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:04.075928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f50a68e8-f778-4906-b125-484080b1f990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045429 Sep 11 05:41:04.076509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 741/1381] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:04.957018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:04.958443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:04.964727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:04.965218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:04.965660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:04.966359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:04.966815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:04.967244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.032032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:05.040307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-792d54ea-db7b-474a-b1dd-ab1ec0099bc0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087182 Sep 11 05:41:05.040864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 742/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:05.045470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:05.047612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:05.053658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.054148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.054589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.055283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.055740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.056196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.085839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6f1dc20-9be2-4914-bc12-aa313e6c268f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Sep 11 05:41:05.086392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 743/1383] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:05.090959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:05.093078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:05.098694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.099178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.099636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.100337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.100794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.101221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.129810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4108d3d-fb4e-48b9-ae60-9dda08b7f70c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041762 Sep 11 05:41:05.130525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 744/1384] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:05.135055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:05.137410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:05.142808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.143293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.143727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.144443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:05.145524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:05.146003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:05.173875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56e4ea7d-a772-47a9-aa3f-97ee557ceeb2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042387 Sep 11 05:41:05.174413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 745/1385] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:06.062978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:06.063626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:06.070433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.070922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.071367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.072094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.072559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.072992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.134525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:06.142648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c90d9661-cd35-4cb8-aa30-4600d74cd710 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083627 Sep 11 05:41:06.143209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 746/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:06 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:06.147935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:06.150077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:06.155695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.156221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.156658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.157358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.157816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.158243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.187720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48658013-ce92-47d7-9837-6e8953b539ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Sep 11 05:41:06.188311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 747/1387] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:06.193328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:06.195435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:06.200986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.201476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.201916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.202609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.203065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.203498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.232786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-361732b5-27f6-4a6e-a358-fbbf6d76706d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Sep 11 05:41:06.233333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 748/1388] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:06.237754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:06.240479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:06.245880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.246363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.246801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.247489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:06.247947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:06.248405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:06.277639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f73524c8-5a29-4d79-83b1-5782f0fd4936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Sep 11 05:41:06.278179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 749/1389] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:07.166020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:07.166682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:07.173045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.173537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.173979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.174679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.175146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.175579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.236247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:07.244256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-022991fa-7ed5-4297-ac69-12bc9b520fb8 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082064 Sep 11 05:41:07.244820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 750/1390] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:07 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:07.249343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:07.251457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:07.257796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.258288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.258728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.259431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.259891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.260388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.290253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bd41470-f5f3-4dea-a4d0-014e733929c7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Sep 11 05:41:07.290812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 751/1391] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:07.295243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:07.297353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:07.302898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.303385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.303830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.304554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.305015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.305443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.334404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-642aabfc-1a9a-4d66-a1e1-49c11fba6a02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042613 Sep 11 05:41:07.334985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 752/1392] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:07.339419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:07.341557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:07.347029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.347511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.348163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.348861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:07.349323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:07.349755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:07.377846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cf83567-734d-4a5f-9458-ed7e35cab94e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041905 Sep 11 05:41:07.378394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 753/1393] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:08.267848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:08.268525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:08.275717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.276241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.276676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.277363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.277813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.278235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.296729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:08.340539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:08.348247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-186e7f73-06ef-4538-909e-22426045a194 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084252 Sep 11 05:41:08.349540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 754/1394] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:08 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:08.354221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:08.356426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:08.362060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.362544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.362979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.363676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.364775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.365198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.394679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66bdf028-c22d-44a6-becf-8c0b954b6a17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Sep 11 05:41:08.395170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 755/1395] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:08.399711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:08.401819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:08.407218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.407698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.408168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.408859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.409314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.409739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.438221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c27b78f-88ab-4146-b82c-8b98762fe42e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 Sep 11 05:41:08.438763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 756/1396] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:08.443891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:08.445974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:08.451390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.451869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.452343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.453024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:08.453476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:08.453896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:08.482193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6527f777-da79-4604-a1de-62dfa6cc59ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042489 Sep 11 05:41:08.482726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 757/1397] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:09.370927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:09.371610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:09.378004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.378482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.378916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.379616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.380094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.380518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.446345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:09.454065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1879f0c1-e83e-48b3-924a-4b223e41cec9 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086994 Sep 11 05:41:09.454625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 758/1398] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:09 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:41:09.460176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:09.462288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:09.467756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.468263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.468729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.469413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.469862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.470279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.498650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4802c7f4-48b8-4344-9a19-a86a412aa9b9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043051 Sep 11 05:41:09.499190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 759/1399] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:09.503525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:09.506502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:09.511840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.512608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.513038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.513716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.514160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.514576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.543462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2008f217-b18a-4931-9fb1-2abf569305f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Sep 11 05:41:09.544026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 760/1400] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:09.548446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:09.550504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:09.556468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.556947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.557386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.558060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:09.558512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:09.558927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:09.588742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c345f5dc-691a-4880-a246-206efedfc649 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043747 Sep 11 05:41:09.589289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 761/1401] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:10.478073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:10.478737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:10.485137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.485624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.486062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.486756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.487211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.487636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.549932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:10.558412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06f8218c-465f-4ca8-b613-fcac453b4a4d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084931 Sep 11 05:41:10.558982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 762/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:10 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:10.563487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:10.565643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:10.571839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.572372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.572799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.573493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.573952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.574381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.602999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cad52ccb-861b-4bfc-95a3-f20a444b4004 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043022 Sep 11 05:41:10.603545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 763/1403] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:10.607982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:10.610096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:10.616209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.616696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.617136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.617828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.618286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.618717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.647460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf10ecaf-5295-48f4-ab28-9b6f5509ee48 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 Sep 11 05:41:10.648023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 764/1404] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:10.652443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:10.654522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:10.659979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.660492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.661525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.662224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:10.662678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:10.663116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:10.691332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0d42a8e-0852-49c7-a8d1-170830651a23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042343 Sep 11 05:41:10.691880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 765/1405] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:11.582189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:11.583464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:11.590040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.590518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.590950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.591632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.592115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.592539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.653251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:11.661663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b920589e-2a4e-4e5f-bcde-c4f9e7dfbf27 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082820 Sep 11 05:41:11.662217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 766/1406] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:11 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:11.666797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:11.668923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:11.674653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.675148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.675593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.676370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.676830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.677262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.708452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adfc5883-48fd-4633-8ea7-d8e1f326476f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 11 05:41:11.709212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 767/1407] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:11.713700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:11.715794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:11.721322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.721807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.722258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.722948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.723678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.724148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.751973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dfa7889-bfc1-4243-9a3a-1ce96d5d061b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Sep 11 05:41:11.752549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 768/1408] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:11.757620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:11.759691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:11.765718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.766203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.766641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.767340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:11.767797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:11.768267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:11.797659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92b6607b-fb94-4917-9a67-5ee7fd4b6c48 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044108 Sep 11 05:41:11.798217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 769/1409] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:12.684985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:12.685640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:12.692439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.692928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.693371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.694092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.694547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.694971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.756859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:12.764858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9053398-ba0b-4509-a497-43a87adf7e06 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083847 Sep 11 05:41:12.765417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 770/1410] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:12 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:12.769887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:12.772925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:12.778535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.778958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.779390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.780095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.780546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.780965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.784485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:12.811832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-380bc54e-5ca9-4b96-923f-af893ee93afc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045394 Sep 11 05:41:12.812415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 771/1411] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:12.816881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:12.819943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:12.825643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.826217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.826650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.827344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.827791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.828256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.857990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99ab9ec4-f7d8-4940-b2e8-cacf0f91b951 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Sep 11 05:41:12.858562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 772/1412] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:12.862984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:12.865487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:12.871066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.871549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.871984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.872708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:12.873162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:12.873617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:12.903069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27aa8607-913b-4d33-9d8e-2bbb5e4f6d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 Sep 11 05:41:12.903625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 773/1413] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:13.788344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:13.789121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:13.795403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.795882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.796350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.797039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.797488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.797910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.865328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:13.871608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e146cf61-0c30-498a-80b6-a72bef404b2b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087236 Sep 11 05:41:13.872190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 774/1414] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:13 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:13.876706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:13.878841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:13.884832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.885318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.885756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.886452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.886918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.887594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.893806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:13.917588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7cb185c-55fe-40ad-9f83-c5379ebfda26 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Sep 11 05:41:13.918147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 775/1415] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:13.922598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:13.924779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:13.930345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.930828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.931300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.931985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.932467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.932893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.963321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-258e9a7a-cb49-43df-838b-adb84877dd38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Sep 11 05:41:13.963882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 776/1416] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:13.968404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:13.970559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:13.976299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.976786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.977226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:13.977918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:13.978379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:13.978807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:14.008852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c8360e3-6a60-44ea-a5f0-6c95ca2bee39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043968 Sep 11 05:41:14.009398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 777/1417] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:14.894247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:14.894853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:14.901981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:14.902468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:14.902903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:14.903601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:14.904082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:14.904512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:14.965480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:14.973324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50378229-c91d-4d53-89a0-3020f3f87e6f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082951 Sep 11 05:41:14.974214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 778/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:14 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:14.978710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:14.980840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:14.986365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:14.986840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:14.987269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:14.987951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:14.988429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:14.988851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:15.018490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44c4c511-68ab-4044-909e-51c93777ed0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Sep 11 05:41:15.018957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 779/1419] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:15.024157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:15.026204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:15.031653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:15.032170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:15.032605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:15.033285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:15.033734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:15.034167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:15.062750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fb61d9a-b9f5-40f0-b6a5-1f30f1f4c055 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Sep 11 05:41:15.063284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 780/1420] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:15.068614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:15.070649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:15.077294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:15.077770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:15.078205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:15.078891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:15.079342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:15.079767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:15.108482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6018b6a2-a369-41e5-a494-83654eec4e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044219 Sep 11 05:41:15.109023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 781/1421] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:15.996141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:15.996825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:16.003129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.003609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.004063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.005392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.005845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.006270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.067701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:16.075526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fe1efc6-5221-40a5-bd66-9f6532f4422a tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083298 Sep 11 05:41:16.076097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 782/1422] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:15 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:16.080544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:16.083377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:16.088902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.089383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.089814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.090501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.090957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.091374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.120462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad5b52fe-81ba-47b2-b31c-dff950010173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Sep 11 05:41:16.121004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 783/1423] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:16.125378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:16.127554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:16.133200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.133675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.134108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.134790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.135236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.135656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.165677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4888d66-fac1-4740-a1d8-70378d06ddf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Sep 11 05:41:16.166281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 784/1424] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:16.170901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:16.172991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:16.178468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.178959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.179373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.180073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:16.180523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:16.180942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:16.210606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e09a7f65-006b-45bf-a376-7201edc3cfc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043366 Sep 11 05:41:16.211145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 785/1425] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:17.097806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:17.098746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:17.105099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.105579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.106009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.106691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.107144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.107563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.170777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:17.179224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86f3641a-9a32-4673-a7e3-82b5e9615fdb tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085283 Sep 11 05:41:17.179792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 786/1426] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:17 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:17.184421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:17.186531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:17.189171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:17.192837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.193321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.193760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.194453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.194908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.195336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.219867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:17.225701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ccb64aae-55a3-4d6a-8d13-af0295a54321 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Sep 11 05:41:17.226255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 787/1427] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:17.230978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:17.233240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:17.239508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.240026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.240471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.241162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.241615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.242047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.270329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2aabfb8e-e220-49e6-8943-06d0e2390090 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Sep 11 05:41:17.270878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 788/1428] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:17.275435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:17.277505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:17.282962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.283439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.283870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.284598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:17.285054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:17.286063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:17.313813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-999ee067-f5a6-48a6-bae9-c0a91d240646 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041919 Sep 11 05:41:17.314349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 789/1429] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:18.201964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:18.202641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:18.209774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.210263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.210706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.211404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.211864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.212326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.276794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:18.284742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df0866d6-09c6-412b-b441-f5a233db093b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086649 Sep 11 05:41:18.285415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 790/1430] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:18 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:18.290931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:18.293135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:18.299096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.299582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.300107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.301018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.301566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.302166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.332091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62e5d9d1-78a6-48d5-806c-cfed91f4e2e2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Sep 11 05:41:18.333405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 791/1431] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:18.338219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:18.340584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:18.346051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.346633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.347092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.348847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.349392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.349831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.377629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eea4f9d4-8b39-4334-bf3f-2081dc0c1dd7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Sep 11 05:41:18.378166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 792/1432] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:18.382878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:18.384985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:18.390658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.391135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.391571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.392282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:18.392730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:18.393151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:18.422677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9944c4ed-a5f9-491e-946c-27fc16774c51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043559 Sep 11 05:41:18.423217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 793/1433] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:19.307449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:19.308149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:19.314421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.314897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.315326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.316031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.316479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.317488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.378476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:19.386966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce7b80dd-59b3-4b32-86a0-702876ae6e31 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083364 Sep 11 05:41:19.387785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 794/1434] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:19 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:19.392298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:19.394418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:19.400600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.401085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.401525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.402223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.402678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.403103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.432465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8624df5d-1b3e-4bc0-bc05-44dcc1fac98d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Sep 11 05:41:19.433010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 795/1435] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:19.437421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:19.439480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:19.445292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.445766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.446208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.446896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.447349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.447774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.479058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98d27946-bea8-4499-96fc-e18a05baadb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Sep 11 05:41:19.479729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 796/1436] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:19.484193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:19.486256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:19.492370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.492850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.493285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.493967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:19.494418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:19.494843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:19.523689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5da54599-dfb4-4978-9c28-52aaa447959b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 Sep 11 05:41:19.524259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 797/1437] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:20.410539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:20.411174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:20.417647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.418129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.418567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.419257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.419714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.420193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.482067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:20.490459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3499d667-a24c-4a67-8ecc-23ae2d690dc5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083858 Sep 11 05:41:20.491015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 798/1438] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:20 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:20.559751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:20.562168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:20.568949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.569434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.569871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.570561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.571015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.571441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.601402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94a42b1a-aac1-4c47-ae9d-dce34c941748 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109392 Sep 11 05:41:20.601957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 799/1439] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:20.606372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:20.608481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:20.614456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.614927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.615360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.616069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.616526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.616948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.645505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68b20f0a-5c8d-4504-bc8c-3181fe7b0b61 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 Sep 11 05:41:20.646043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 800/1440] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:20.650416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:20.652487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:20.657963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.658445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.658883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.659572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:20.660056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:20.661071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:20.690512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fd81a81-579c-4056-8d00-39e0618d2bab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043504 Sep 11 05:41:20.691063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 801/1441] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:21.514796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:21.515474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:21.521886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.522373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.522809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.523503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.523960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.524415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.585349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:21.592930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a069e01-94f6-4f8d-8817-2831427ebab6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082255 Sep 11 05:41:21.593491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 802/1442] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:21 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:21.612929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:21.615820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:21.621479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.621958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.622390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.623078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.623525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.623945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.652528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-641db4d2-2855-4d6d-9466-21f23278f7d6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Sep 11 05:41:21.653063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 803/1443] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:41:21.657541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:21.659843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:21.666008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.666486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.666922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.667611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.668087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.668510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.684419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:21.698358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9b0808a-31c5-490d-a958-5f7d461e0701 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Sep 11 05:41:21.698909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 804/1444] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:21.703343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:21.705413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:21.711628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.712149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.712582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.713263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:21.713711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:21.714129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:21.742321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70a6a6bb-d106-4656-bbd6-476eac1cfc52 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042457 Sep 11 05:41:21.742861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 805/1445] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:22.617556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:22.618241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:22.624475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.624956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.625389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.626075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.626528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.626950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.692813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:22.700394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3935b3a1-3669-477b-b8cc-332babff8112 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087423 Sep 11 05:41:22.700949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 806/1446] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:22 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:22.705441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:22.707552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:22.713065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.713551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.713980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.714667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.715116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.715536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.744809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-980432dd-b2ee-41a4-9b12-94315f982f6f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042888 Sep 11 05:41:22.745352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 807/1447] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:22.750030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:22.752148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:22.758523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.759003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.759438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.760151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.760602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.761027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.789618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb8f2cc6-0946-4989-a0d2-27106c2e1a3e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Sep 11 05:41:22.790167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 808/1448] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:22.794877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:22.796988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:22.803256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.803734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.804201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.804898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:22.805346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:22.805768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:22.834833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b0501d5-abed-4f7b-9723-dde29453fab8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043692 Sep 11 05:41:22.835380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 809/1449] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:23.723561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:23.724281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:23.730888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.731368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.731805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.732524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.732976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.733397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.795548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:23.804252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-132c28bd-4e06-402e-8613-d08db6e019fa tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084422 Sep 11 05:41:23.804828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 810/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:23 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:23.809474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:23.811623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:23.817496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.817974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.819058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.819980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.820455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.820878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.849937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9102a40-ed42-436b-9e6a-57d53a83b03f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Sep 11 05:41:23.850480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 811/1451] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:23.854986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:23.857130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:23.862700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.863186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.863628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.864360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.864817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.865246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.900754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e23d5ff-0579-4439-a292-3864f8b49eed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049209 Sep 11 05:41:23.901305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 812/1452] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:23.905761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:23.907853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:23.913427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.913907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.914346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.915036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:23.915492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:23.915917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:23.944777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-519daf14-6a34-4420-9eb4-7a442cbff982 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 Sep 11 05:41:23.945323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 813/1453] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:24.826992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:24.827608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:24.834558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.835044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.835484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.836203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.836665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.837093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.898328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:24.906022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cbb4030a-d340-49c6-b177-2f41e8bd561c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082989 Sep 11 05:41:24.906574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 814/1454] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:24 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:24.911243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:24.913980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:24.919759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.920291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.920740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.921482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.922061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.922499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.952583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80ac5d7c-ace9-4ab3-96b9-d45c9f8d28c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Sep 11 05:41:24.953145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 815/1455] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:24.957767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:24.960598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:24.966344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.966832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.967277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.967975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:24.968459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:24.968894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:24.997830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e6bef67-8772-4a60-81a4-b7f2a90169dd tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Sep 11 05:41:24.998306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 816/1456] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:25.002794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:25.004889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:25.011189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:25.011673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:25.012406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:25.013099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:25.013557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:25.013984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:25.042508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6751d4e-a64a-461a-a4d3-19c696e4c3ef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043182 Sep 11 05:41:25.043055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 817/1457] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:25.929694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:25.930338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:25.936733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:25.937219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:25.937660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:25.938357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:25.938815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:25.939241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.000478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:26.008919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0760b83-39d0-4deb-bbf2-c1dfbcefd33d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083247 Sep 11 05:41:26.009488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 818/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:25 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:26.014233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:26.016377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:26.022573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.023079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.023520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.024249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.024707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.025135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.055275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4042b72f-833f-4b63-8f5e-e348c1755000 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Sep 11 05:41:26.055843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 819/1459] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:26.060403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:26.062447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:26.068021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.069309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.069796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.070483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.070937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.071361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.100626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ff645d0-86fe-45ce-9241-bb62eb41c00c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Sep 11 05:41:26.101178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 820/1460] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:26.105609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:26.107686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:26.113057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.113535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.113971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.114654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:26.115319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:26.115715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:26.119324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:26.145270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f55a824f-c02b-4a3f-b638-e5feb9a23f7c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043114 Sep 11 05:41:26.145813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 821/1461] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:27.033288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:27.033900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:27.041023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.041527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.041973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.042689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.043152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.043587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.108862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:27.117168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09db6f04-b2f2-469f-ad23-19e728e3ba2f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087820 Sep 11 05:41:27.117718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 822/1462] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:27 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:27.122339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:27.124571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:27.130395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.131596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.132053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.132748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.133196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.133616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.162216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb72a335-c054-4c35-90ef-4496dbde6566 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Sep 11 05:41:27.162757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 823/1463] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:27.167265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:27.169378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:27.174735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.175209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.175639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.176364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.176799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.177217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.205857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af5942a7-4102-4231-b8c6-dca7749d7256 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Sep 11 05:41:27.206414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 824/1464] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:27.210902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:27.212993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:27.218473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.218953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.219387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.220109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:27.220564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:27.220988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:27.250402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e287afe7-6617-4872-8e7e-8ea86b6c1b19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042998 Sep 11 05:41:27.250942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 825/1465] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:28.140723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:28.141341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:28.149648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.149648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.149648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.150355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.150793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.151217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.212878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:28.220604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c98b650f-0f67-40f8-90b6-6afa1ff13c98 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084075 Sep 11 05:41:28.221159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 826/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:28 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:28.225966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:28.228126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:28.233517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.233989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.234421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.235102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.235549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.235968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.264857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf02527b-49b3-49b5-b757-3342d9edb96a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Sep 11 05:41:28.265396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 827/1467] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:28.269744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:28.272783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:28.278239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.278720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.279150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.279826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.280296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.280717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.310414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6aa92275-b2e4-431e-be1d-3f8e1ab6d3db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Sep 11 05:41:28.310965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 828/1468] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:28.315360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:28.317442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:28.323718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.324236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.324672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.325352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:28.325799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:28.326221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:28.355030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9d7a38e-ec4f-4bcb-8ba5-d4d4e73bcf75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043040 Sep 11 05:41:28.355501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 829/1469] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:29.244497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:29.245154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:29.251006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.251483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.251912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.252622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.253071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.253494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.313895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:29.322120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5df9cdf9-6d92-4f02-a5c8-20b92b87db6b tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082481 Sep 11 05:41:29.322671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 830/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:29 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:29.327096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:29.329288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:29.335719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.336226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.336655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.337345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.337793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.338212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.367741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fdfe59ea-6cf4-4318-9580-9712d222404d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Sep 11 05:41:29.368315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 831/1471] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:29.372740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:29.374792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:29.380270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.381536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.382131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.382813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.383265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.383690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.411558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70835cb7-7e59-43d2-ba4f-9b7d26902fb0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Sep 11 05:41:29.412372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 832/1472] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:29.416766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:29.418793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:29.424088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.424562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.424991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.425664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:29.426110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:29.426531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:29.455777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-684dbd70-7ffc-40b4-b4ff-a450f3a17f24 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042428 Sep 11 05:41:29.456331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 833/1473] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:30.345318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:30.345996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:30.347939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:41:30.348108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 (ip 10.222.0.33) !!! Sep 11 05:41:30.355395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.355873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.356339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.357030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.357481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.357904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.420745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:30.428846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01376a7c-7921-4518-a0c7-3d86745a3d5d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087376 Sep 11 05:41:30.429406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 834/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:30 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:30.433854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:30.435954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:30.441591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.442078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.442517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.444219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.444651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.445079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.477455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19d4ac85-9e93-4589-9910-edbec0d5adcf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047028 Sep 11 05:41:30.478011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 835/1475] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:30.482437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:30.484592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:30.490157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.490641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.491074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.491764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.492256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.492683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.521950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba47b717-4b4d-4ef9-b213-d5a7b52f3205 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042237 Sep 11 05:41:30.522495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 836/1476] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:30.526884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:30.528994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:30.531543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:30.535001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.535481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.535916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.536631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:30.537655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:30.538081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:30.563398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:30.568862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a00668fd-9792-4efe-9dc9-245490e8e137 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045424 Sep 11 05:41:30.569410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 837/1477] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:31.451653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:31.452358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:31.458665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.459489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.459932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.460651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.461103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.461527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.526121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:31.533890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2453a5d7-f305-495c-bed6-c4bf40d227e6 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086331 Sep 11 05:41:31.534447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 838/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:31 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:31.539876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:31.542020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:31.547449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.547931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.548392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.549075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.549527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.549946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.579423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-613c3be2-24b8-41ab-90ae-55d2cc4ee7be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Sep 11 05:41:31.579971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 839/1479] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:31.585190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:31.587262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:31.592775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.593248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.593677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.594357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.594802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.595223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.623820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49e7d871-85cc-49ba-ba6c-82e3ed428b3d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Sep 11 05:41:31.624396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 840/1480] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:31.628909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:31.631501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:31.636917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.637660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.638092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.638772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:31.639219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:31.639641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:31.669561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e88d2a1f-30d8-4415-94ab-18c7b3a1affe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Sep 11 05:41:31.670121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 841/1481] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:32.557797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:32.558475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:32.564855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.565342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.565781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.566477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.566937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.567364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.629248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:32.637365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0faa2060-95e3-4718-9357-28a5725e7eb4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.083240 Sep 11 05:41:32.637935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 842/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:32 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:32.642423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:32.644573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:32.650690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.651181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.651621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.652349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.652812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.653244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.683536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83072c01-9817-4760-9fe0-f501f4a2a900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Sep 11 05:41:32.684126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 843/1483] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:32.688606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:32.691192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:32.696961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.697448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.697888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.698583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.699042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.699470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.727929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0825060-c828-4296-9a98-6057382ff92f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Sep 11 05:41:32.728514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 844/1484] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:32.732957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:32.735011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:32.740968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.741448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.741888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.742582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:32.743039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:32.743468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:32.773430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9a13675-0783-484a-8a87-8bd9d50d3e5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043922 Sep 11 05:41:32.773991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 845/1485] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:33.660459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:33.661213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:33.667550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.668065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.668508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.669214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.669673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.670135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.733786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:33.742095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-499b25d8-dc9e-444e-b79b-328a0efd0fce tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085452 Sep 11 05:41:33.742651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 846/1486] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:33 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:33.747133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:33.749288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:33.754787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.755266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.756384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.757077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.757528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.757953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.787102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa77c63c-f278-42b3-bfbe-c9d7880a7d3e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Sep 11 05:41:33.787814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 847/1487] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:33.792399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:33.794531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:33.800227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.800713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.801153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.801851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.802859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.803476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.833668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-844458ed-3e35-48c4-9f77-20e548937fb1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Sep 11 05:41:33.834228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 848/1488] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:33.838730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:33.840852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:33.846346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.846828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.847266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.847954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:33.848439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:33.848862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:33.877697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93d90fbf-a49d-4ff6-af25-fb7825900722 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 Sep 11 05:41:33.878233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 849/1489] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:34.765678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:34.766290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:34.773462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.773940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.774370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.775057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.775508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.775930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.837744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:34.845604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7136a33-bfea-465b-8cd2-38595b91b7ca tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084010 Sep 11 05:41:34.846168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 850/1490] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:34 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:34.851629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:34.853803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:34.859429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.859916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.860389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.861087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.861544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.861971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.891567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c661dec-5ce6-4809-bb8f-662ce557534b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Sep 11 05:41:34.892140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 851/1491] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:34.897360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:34.899480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:34.905022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.905509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.905962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.906657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.907116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.907544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.935801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c856783-c9b8-4b53-aaa8-df46e291f01f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042680 Sep 11 05:41:34.936380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 852/1492] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:34.940869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:34.943481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:34.949052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.949541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.949983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.950680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:34.951145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:34.951577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:34.980650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37194c8a-8ac2-466f-8204-4cb372c7ae80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043292 Sep 11 05:41:34.981198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 853/1493] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:35.869810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:35.870451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:35.876892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:35.877370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:35.877801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:35.878487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:35.878937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:35.879361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:35.897407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:35.945234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:35.953045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f127d27d-b767-4623-a089-0a5603cacbc3 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087978 Sep 11 05:41:35.953601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 854/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:35 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:35.958082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:35.960744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:35.966414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:35.966897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:35.967336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:35.968054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:35.968509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:35.968934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:35.999708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-494bed53-b89f-4163-90e6-bfaa61cea336 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Sep 11 05:41:36.000285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 855/1495] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:36.004839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:36.006916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:36.012684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.013165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.013609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:36.014292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.014747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.015172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:36.044808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd73ec80-dbf2-4cad-b6c9-01e526dbac6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Sep 11 05:41:36.045688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 856/1496] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:36.050564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:36.052497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:36.058381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.058866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.059303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:36.060033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.060474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.060900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:36.090124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-808faec4-5329-4ab7-a4df-dd2d3274bc26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043471 Sep 11 05:41:36.090670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 857/1497] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:36.977312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:36.977944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:36.980353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:41:36.980500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:41:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 (ip 10.222.0.33) !!! Sep 11 05:41:36.986098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.986581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.987020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:36.987717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:36.988207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:36.988635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.050452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:37.059284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-712f7d1d-248b-49fb-9007-e28a3db78e00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085882 Sep 11 05:41:37.059854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 858/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:36 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:37.064508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:37.066687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:37.073198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.073686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.074125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.074848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.075301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.075726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.104412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a429a086-8754-44da-9471-3ff8ba7c4bd9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Sep 11 05:41:37.104958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 859/1499] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:37.109382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:37.111514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:37.117432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.117911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.118350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.119039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.119493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.119925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.148200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-471eb3da-b263-4e64-a1a6-4ed6c73cdcdf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Sep 11 05:41:37.148752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 860/1500] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:37.159895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:37.161995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:37.168100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.168588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.169026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.169711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:37.170166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:37.170592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:37.199308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88feaf51-a85b-478a-901f-1acaf56db758 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Sep 11 05:41:37.199851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 861/1501] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:38.082310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:38.082920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:38.090260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.090739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.091175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.091863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.092344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.092765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.156985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:38.165164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff58aad2-9fbd-4780-b066-8de46909aa8c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086736 Sep 11 05:41:38.165719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 862/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:38 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:38.170177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:38.172319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:38.178136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.178881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.179381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.180110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.180599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.181028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.210648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf10f6fc-121e-47aa-8dca-ae2e1f1ad740 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Sep 11 05:41:38.211228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 863/1503] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:38.215629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:38.217757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:38.223202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.223682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.224227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.224915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.225375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.225797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.254144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1469962b-d798-4a9f-a6c5-f1eb78f1e7fc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041954 Sep 11 05:41:38.254680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 864/1504] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:38.259955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:38.262060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:38.267712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.268262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.268694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.269378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:38.269829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:38.270254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:38.299209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc3dbad2-ac01-4142-9c23-39e112aeb9d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043569 Sep 11 05:41:38.299748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 865/1505] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:39.187344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:39.187962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:39.194781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.195268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.195706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.196458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.196899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.197328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.257903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:39.265932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c59c8f2-f597-4978-94ec-e15508c975c0 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.082569 Sep 11 05:41:39.266489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 866/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:39 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:39.270978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:39.273734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:39.279531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.280102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.280544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.281237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.281686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.282106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.311720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddfbb002-4f06-478e-9cf4-a1f7f6a288d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Sep 11 05:41:39.312291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 867/1507] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:39.316815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:39.319619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:39.325220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.325698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.326130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.326814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.327264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.327686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.356024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97794a51-9535-4737-9f5a-4c2e0058aea3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042640 Sep 11 05:41:39.356562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 868/1508] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:39.360929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:39.362962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:39.368607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.369098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.369535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.370215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:39.370663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:39.371084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:39.400914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a470194-1809-46a4-9ae6-244bad2d2534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043400 Sep 11 05:41:39.401453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 869/1509] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:40.288701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:40.289338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:40.295596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.296107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.296545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.297228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.297679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.298098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.361919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:40.370572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55c9d6b4-f071-4919-8a6e-077acb1474c5 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086227 Sep 11 05:41:40.371071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 870/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:40 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:40.375661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:40.377792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:40.383598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.384130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.384576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.385287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.385798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.386227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.390288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:40.416226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed0bcfae-7eb7-4e27-9d12-9b9e8d672f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Sep 11 05:41:40.416781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 871/1511] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:40.421151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:40.423241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:40.429429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.429906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.430345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.431033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.431490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.431919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.461676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a07537f-ac0c-40b8-a6cf-932daa7f1f1f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Sep 11 05:41:40.462225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 872/1512] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:40.466702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:40.468829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:40.474661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.475770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.476234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.476922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:40.477370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:40.477790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:40.505896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb9fe959-b661-4b6c-b9d4-0b59d3196b7a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042704 Sep 11 05:41:40.506595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 873/1513] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:41.393412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:41.394087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:41.400739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.401227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.401668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.402396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.402857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.403319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.465761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:41.473766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc20388d-220d-4970-9e92-8465ecf0c6d7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.084198 Sep 11 05:41:41.474337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 874/1514] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:41 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:41.478909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:41.481056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:41.486547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.487029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.487470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.488195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.488646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.489072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.518866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8a8e905-6b05-4f11-b4b5-8f6c70e9db9f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Sep 11 05:41:41.519410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 875/1515] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:41.523909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:41.526020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:41.531532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.532021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.532473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.533159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.533616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.534042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.562880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42c38b76-febd-4989-928d-5869d056817d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Sep 11 05:41:41.563429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 876/1516] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:41.567970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:41.570656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:41.576262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.576742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.577180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.577867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:41.578321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:41.578745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:41.607565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76f7a958-fc42-4973-832f-9a37e525d401 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043165 Sep 11 05:41:41.608131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 877/1517] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:42.495918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:42.496624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:42.503364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.503880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.504408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.505104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.505557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.505982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.568135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:42.577097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eafba131-a2f5-4293-9109-d47e10881393 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.085260 Sep 11 05:41:42.577656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 878/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:42 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:42.582323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:42.585421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:42.591115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.591591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.592043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.592735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.593186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.593607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.623019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-999eb022-d19d-4635-a9d5-12f973f72524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Sep 11 05:41:42.623597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 879/1519] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:42.628418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:42.630863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:42.637553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.638034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.638466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.639161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.640050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.669166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b2f4cc7-b5ca-48e7-b3ee-4ab91504c72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Sep 11 05:41:42.669707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 880/1520] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:42.674338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:42.676496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:42.682055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.682532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.682965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.683645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:42.684127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:42.684551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:42.714483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8de04f03-7fb4-4dd0-917b-c0d9a766db0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Sep 11 05:41:42.715026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 881/1521] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:43.600491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:43.601139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:43.608026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.608511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.608951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.609647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.610103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.610530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.675668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:43.683617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bde9d054-b53d-4b45-93e3-0ac417c9c8d4 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087158 Sep 11 05:41:43.684214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 882/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:43 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:43.688699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:43.690822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:43.696534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.697016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.697452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.698143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.698599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.699032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.728572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8fa0133f-408f-4b9d-af83-fd199fb737e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Sep 11 05:41:43.729136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 883/1523] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:43.733638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:43.735755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:43.741730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.742425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.743021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.743921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.744406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.744833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.777156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96b4a8e8-5bd5-4fe8-89d6-2dbb57493aee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Sep 11 05:41:43.777698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 884/1524] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:43.782135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:43.784213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:43.790246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.790726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.791163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.791857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:43.792334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:43.792760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:43.822113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42cdb311-d814-427d-9bdc-a6cbe1598475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043411 Sep 11 05:41:43.822668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 885/1525] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:44.706632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:44.707300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:44.713737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.714223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.714663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.715355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.715812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.716266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.780440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:41:44.788893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89fb390a-0ca6-47ff-b5b1-2a7a890fcda7 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.086059 Sep 11 05:41:44.790046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 886/1526] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:41:44 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:41:44.794068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:44.796214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:44.799000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:44.803874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.804465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.804905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.805616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.806073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.806732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.831269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:44.836592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2630d3df-629c-4e6a-9140-1e5811e7bf75 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Sep 11 05:41:44.837148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 887/1527] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:44.841801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:44.843896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:44.849484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.850511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.850948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.851643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.852121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.852551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.880584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5745698d-3415-4dfe-bf2a-6bca32467f50 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Sep 11 05:41:44.881890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 888/1528] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:41:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:41:44.886359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:44.888718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:44.894174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.894654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.895092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.895777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.896251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.896677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.925022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16a2abab-96be-4f4d-aabd-edcf279f1529 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042172 Sep 11 05:41:44.925566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 889/1529] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:41:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:41:44.930069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:41:44.930514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:41:44.935860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.936374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.936813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:44.937499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:41:44.937957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:41:44.938380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:41:54.933562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:54.957062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=16 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:41:57.963593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:41:57.964271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:42:45.290475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:42:45.294524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:42:45.296230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:42:45.297017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:42:45.298327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:42:45.299727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:42:45.300992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) Sep 11 05:42:45.303259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:42:45.306059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ed24d88-1244-48fd-bd78-cc6bfebc4dfc) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:42:45.306059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7692525-62f6-4afa-89fc-451d2ddd10b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 120.017118 Sep 11 05:42:45.306059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 641/1530] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:40:45 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 120018 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:42:45.368637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:42:45.369251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:42:45.375011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.375488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.375922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.376638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.377085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.377510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.410428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:42:45.440979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:42:45.449279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c6ef8cd-03e3-487c-939e-bb6cd10d1f00 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.151854 Sep 11 05:42:45.460902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 642/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:42:45 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:42:45.460902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:42:45.460902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:42:45.463761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.464278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.464721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.465445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.466073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.466756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.503331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57e865de-b144-4b4e-9c16-0927b059ac73 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052367 Sep 11 05:42:45.504032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 643/1532] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:42:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:42:45.509303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:42:45.511583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:42:45.517787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.518267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.518803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.519490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.519936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.520379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.549637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3bdfe3f-c3fd-4edc-a59e-20c3c998bf67 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Sep 11 05:42:45.550179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 644/1533] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:42:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:42:45.555494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:42:45.557574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:42:45.562906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.563517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.563953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.564653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.565100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.565526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.594830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31cf3c09-9d43-4f89-8c1f-5344fa5c367b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Sep 11 05:42:45.595385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 645/1534] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 05:42:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:42:45.600909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:42:45.601392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:42:45.606699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.607169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.607598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:45.608311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:42:45.608760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:42:45.609180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:42:55.415839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:42:55.604739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:42:55.626972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:04.084398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:43:04.087191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:43:04.088715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:43:04.089590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:43:04.090762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:43:04.092061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:43:04.093145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) Sep 11 05:43:04.094273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:43:04.095345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb5542b7-38a1-48fc-9d99-e9aec8e6d7f2) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:43:04.095345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fba2eb5-4621-4670-9473-b548dfbad71a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 79.162207 Sep 11 05:43:04.095345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 890/1535] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:41:44 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 79163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:43:04.095581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:43:04.096057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:43:04.102061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:43:04.102547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:43:04.102987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:43:04.103692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:43:04.104184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:43:04.104617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:43:04.176146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:43:12.851574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:43:12.852180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:43:14.099563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:14.123059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:14.181221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:43:18.032400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:43:18.033111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:43:54.965930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:43:54.966637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:44:45.609040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid 811bc271-657e-410b-9fb8-dfc4c0ca1880 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:44:45.637122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:44:45.639611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:44:45.641450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:44:45.643202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:44:45.647213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:44:45.650557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:44:45.652430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) Sep 11 05:44:45.655149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:44:45.658106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52ae6518-f3a5-4137-8978-073e6f14d1d9) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:44:45.658106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1733d3d0-84eb-4dfb-9967-bd7b83cf484f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 120.044771 Sep 11 05:44:45.658106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 646/1536] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:42:45 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 120046 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:44:45.658106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:44:45.658475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:45.658475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.658475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.658475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:45.658837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.658837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.658837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:45.722190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:44:45.730606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffb0ac44-7aa4-4360-8cbd-fefd1918a88f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087917 Sep 11 05:44:45.731182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 647/1537] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:44:45 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:44:45.735720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:44:45.737904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:45.744097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.744582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.745026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:45.745723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.746183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.746611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:45.775639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5236d5e1-5121-4c50-a23e-d2490b2ee69e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Sep 11 05:44:45.776120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 648/1538] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:44:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:44:45.964038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:44:45.966258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:45.972130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.972610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.973045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:45.973732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:45.974175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:45.974595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.003762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-649f256f-1296-4b0d-94e9-7f12df69407d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226601 Sep 11 05:44:46.004338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 649/1539] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:44:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:44:46.008845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:44:46.010879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:46.016382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.016853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.017281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.017954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.018424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.018822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.120581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88e5eab2-7de7-4933-9709-609f6f7e4543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action" status: 200 len: 37637 microversion: 2.20 time: 0.114916 Sep 11 05:44:46.121231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 650/1540] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 11 05:44:46 2022] POST /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe/action => generated 37637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:44:46.126393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:44:46.128606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:46.135827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.136335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.136767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.137451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.137897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.138597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.168416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1015c33f-97e7-4f08-b870-4f14ffc6802c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Sep 11 05:44:46.168949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 651/1541] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:44:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:44:46.173480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:44:46.173957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:44:46.179648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.180165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.181463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:46.182137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:44:46.182588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:44:46.183009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:44:50.366007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:44:50.366594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 (ip 10.222.0.33) !!! Sep 11 05:44:55.613054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:56.177583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=12 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:56.200203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=32 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:44:57.008400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:44:57.008988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:44:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 (ip 10.222.0.33) !!! Sep 11 05:45:04.249621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [af3d19ff-efad-4b1a-9391-ff7b34d5df55] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 05:45:04.287893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:45:05.257730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [af3d19ff-efad-4b1a-9391-ff7b34d5df55] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54966. Sep 11 05:45:05.261303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dca3a6fb-deee-40f5-8eb5-fd385f62d505 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59" status: 202 len: 0 microversion: 2.1 time: 121.171084 Sep 11 05:45:05.261900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 891/1542] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:43:04 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 => generated 0 bytes in 121172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:45:05.268882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:45:05.269502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:45:05.276575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:45:05.277191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:45:05.277593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:45:05.278373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:45:05.278929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:45:05.279406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:45:14.291922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:45:15.272899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:45:15.300086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:46:32.862304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:46:32.862823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:46:38.042549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:46:38.043199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 (ip 10.222.0.33) !!! Sep 11 05:46:45.918703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:46:45.921504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:46:45.923000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:45.923687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:45.924949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:45.926137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:45.927220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) Sep 11 05:46:45.928411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:45.929534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca618fc3-2138-407f-b3e3-14e8e8260877) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:46:45.929534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2b5b5a5-17fb-4266-9d2c-bc7086a8efe6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 119.753478 Sep 11 05:46:45.929534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 652/1543] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:44:46 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 119754 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:46:45.930013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:45.930620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:45.937565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:45.937907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:45.938308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:45.939001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:45.939456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:45.939880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.004368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:46:46.012270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-856a5dc6-0d93-4725-9cd2-6ca3af23662f tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.087144 Sep 11 05:46:46.012822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 653/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:46:45 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:46:46.019724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid 811bc271-657e-410b-9fb8-dfc4c0ca1880 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:46:46.136766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.139304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.145682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.146219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.146658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.147354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.147800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.148254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.178300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2cb0cf3-9b81-4bde-9732-e0ad1f4b6c53 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162785 Sep 11 05:46:46.178848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 654/1545] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.183640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.186411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.191906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.192404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.192835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.193518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.193966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.194378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.223803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c511c155-50be-4f01-a51a-86dcd7f6d607 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Sep 11 05:46:46.224611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 655/1546] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.248796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Request method failure captured: Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 HTTP/1.1 Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXMCGuMiofl0TAMkpohNl8SPrHe9pwOzUchyTOpdNP1mSjvMnLPIUj4yJTRGa7GUIE2Da0nCDoLnpFW10kUeSN2nzmvfMY3N_BY1zjvLfYvL2i8v5JCDN-ABmAPyicd3Lo26ZkwUuWqgcq74c7GA3ruM9LcDntTMt1QCYZri1S52NJc Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:46:46.251092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbab28318bf84c88b2f3a774defb870f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}] Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 9793a6256764417eb3ff1a8386368801 Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:46:46.252696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '811bc271-657e-410b-9fb8-dfc4c0ca1880', 'id': 'd7a3a010-d9bf-430f-a952-d31b37daff59'} Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.254217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.255873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.257892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.259239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) Sep 11 05:46:46.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.261942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f71fb50-fbe4-4d5b-8301-5f032fe7eab8) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:46:46.261942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-240b2050-008c-433c-b09f-cfb59c528a44 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59" status: 400 len: 269 microversion: 2.1 time: 100.989547 Sep 11 05:46:46.261942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 892/1547] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:45:05 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 => generated 269 bytes in 100991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:46:46.261942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.262439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.265172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.265662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.266105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.266806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.267263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.267689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.347264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.348416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:46:46.349573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.360279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.360858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.361675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.362628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.363349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.364067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.396984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7603b73a-113d-4828-89f0-d9d685c0427c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171285 Sep 11 05:46:46.397592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 656/1548] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.402253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.402741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.408321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.408798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.409251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.409917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.410362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.410786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.434238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:46:46.437327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:46:46.438669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.439315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.440400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.442453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.443762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) Sep 11 05:46:46.446055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.448859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a6e7933-8ab0-4e70-b8a9-a7401ffdcfdb) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:46:46.448859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f87a537-03c7-49cb-bd59-82aa25a6605d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 0.184782 Sep 11 05:46:46.448859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 893/1549] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:46:46 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:46:46.448859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.449391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.453137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.453632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.454071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.456227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.456697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.457169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.495340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid 811bc271-657e-410b-9fb8-dfc4c0ca1880 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:46:46.523041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:46:46.533625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6743fb99-206a-4ddf-be92-9cd6310bef3c tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1226 microversion: 2.1 time: 0.093287 Sep 11 05:46:46.534524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 894/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:46:46.539832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.542118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.548763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.549252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.549696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.550432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.550853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.551288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.556650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Request method failure captured: Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 HTTP/1.1 Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXMCGuMiofl0TAMkpohNl8SPrHe9pwOzUchyTOpdNP1mSjvMnLPIUj4yJTRGa7GUIE2Da0nCDoLnpFW10kUeSN2nzmvfMY3N_BY1zjvLfYvL2i8v5JCDN-ABmAPyicd3Lo26ZkwUuWqgcq74c7GA3ruM9LcDntTMt1QCYZri1S52NJc Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:46:46.558810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbab28318bf84c88b2f3a774defb870f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}] Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 9793a6256764417eb3ff1a8386368801 Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:46:46.560568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '811bc271-657e-410b-9fb8-dfc4c0ca1880', 'id': 'd7a3a010-d9bf-430f-a952-d31b37daff59'} Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.561667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:46:46.563513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.565599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.566951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) Sep 11 05:46:46.568301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:46:46.570444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6bf97272-e0ed-40ee-8cc9-ac6a4b92eec0) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:46:46.570444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-574d40ab-6b07-4c82-9266-3200f13bad3c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59" status: 400 len: 269 microversion: 2.1 time: 0.161687 Sep 11 05:46:46.570444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 657/1551] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:46:46 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 => generated 269 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:46:46.570444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.570843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.575209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.575723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.576392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.577264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.577718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.578145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.596442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd3969a9-2efc-4b75-a53c-87279c50e8c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060904 Sep 11 05:46:46.597024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 895/1552] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.601616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.603828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.610283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.610599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03e13fd4-dd0a-403e-a18e-f73745c2b6b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Sep 11 05:46:46.610775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.611171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 658/1553] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.611380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.611911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.612397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.612834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.615913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.616437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.621988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.622577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.622987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.623688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.624177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.624602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.642300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c450dec6-5492-499c-b79d-47157e8ea88f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Sep 11 05:46:46.642862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 896/1554] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:46:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:46:46.647374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:46:46.647872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:46:46.654584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.655069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.655509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:46.656235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:46:46.656688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:46:46.657118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:46:56.620014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=14 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:46:56.642239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=42 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:46:56.651446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=10 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:46:56.675605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=34 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:04.399438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.442607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid 811bc271-657e-410b-9fb8-dfc4c0ca1880 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.520277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:47:04.522597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:47:04.524244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.525269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.526544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.527922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.529527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) Sep 11 05:47:04.531279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.532581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89694484-7cf2-484e-a413-19e938dab869) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:04.532581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f96c818f-5b50-40de-bec3-fd0bc7beaa30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 17.911941 Sep 11 05:47:04.532581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 659/1555] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:46:46 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 17913 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:47:04.539790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.540458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.549056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.549470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.550024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.550644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.551223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.551667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.558274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Request method failure captured: Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 HTTP/1.1 Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXMCGuMiofl0TAMkpohNl8SPrHe9pwOzUchyTOpdNP1mSjvMnLPIUj4yJTRGa7GUIE2Da0nCDoLnpFW10kUeSN2nzmvfMY3N_BY1zjvLfYvL2i8v5JCDN-ABmAPyicd3Lo26ZkwUuWqgcq74c7GA3ruM9LcDntTMt1QCYZri1S52NJc Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:47:04.561373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbab28318bf84c88b2f3a774defb870f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}] Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 9793a6256764417eb3ff1a8386368801 Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:47:04.563588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '811bc271-657e-410b-9fb8-dfc4c0ca1880', 'id': 'd7a3a010-d9bf-430f-a952-d31b37daff59'} Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.565022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.567289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.569985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.572484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) Sep 11 05:47:04.574660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.577347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60e845e9-cbad-4bdf-a152-e2c7db098529) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:04.577347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00038a34-28ed-46e4-a27c-fd1aaf9a465a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59" status: 400 len: 269 microversion: 2.1 time: 17.918949 Sep 11 05:47:04.577347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 897/1556] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:46:46 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 => generated 269 bytes in 17920 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:47:04.577347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.577875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.578632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.579276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.579762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.580435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.580898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.581329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.588445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.588928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.589429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.589890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lazy-loading 'fault' on Instance uuid c4c14da8-f044-490c-86b4-f1cef62ed399 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.613072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b16f8dc-edf0-49f6-98b7-45ab5934e260 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048523 Sep 11 05:47:04.613645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 898/1557] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:04.618693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.620869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.628393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.628882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.629323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.630038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.630503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.630962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.635253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:47:04.648745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-155e60ea-b05e-4abb-9e9c-cb4a25e7eda2 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1231 microversion: 2.1 time: 0.122633 Sep 11 05:47:04.649479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 660/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:47:04.655227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.657741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.663092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bf42d51-4c49-45dd-a375-1cb3d8335f56 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048153 Sep 11 05:47:04.664066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 899/1559] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:04.667116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.667931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.668804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.669858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.670320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.671054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.671516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.671937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.675933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.676457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.676893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.677878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.678338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.678760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.707320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ac1e225-7964-4f34-a9f2-6da0a1b0b193 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056483 Sep 11 05:47:04.708050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 661/1560] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:04.713112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.713599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.720124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.720611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.721039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.721736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.722186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.722605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.766915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'services' on Instance uuid 45817200-bc9c-4b2e-9a6d-73fb57c45699 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.819177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lazy-loading 'services' on Instance uuid 811bc271-657e-410b-9fb8-dfc4c0ca1880 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.848421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 HTTP/1.1 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:47:04.850604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 05:47:04.851977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '45817200-bc9c-4b2e-9a6d-73fb57c45699', 'id': '5fd40bdf-d453-432e-920a-0c5563013589'} Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.852898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.854319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.855546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.857292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) Sep 11 05:47:04.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.861220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fc5bcd7-0ce3-4993-91dc-fe6c946d2e95) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:04.861220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ad02ee8-9c97-41ea-b8a4-748b66506082 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589" status: 400 len: 269 microversion: 2.1 time: 0.186984 Sep 11 05:47:04.861220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 900/1561] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:47:04 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments/5fd40bdf-d453-432e-920a-0c5563013589 => generated 269 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:47:04.861220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.861725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.866910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.867401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.867837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.868587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.869045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.869472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.889067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Request method failure captured: Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 HTTP/1.1 Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXMCGuMiofl0TAMkpohNl8SPrHe9pwOzUchyTOpdNP1mSjvMnLPIUj4yJTRGa7GUIE2Da0nCDoLnpFW10kUeSN2nzmvfMY3N_BY1zjvLfYvL2i8v5JCDN-ABmAPyicd3Lo26ZkwUuWqgcq74c7GA3ruM9LcDntTMt1QCYZri1S52NJc Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:47:04.891532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbab28318bf84c88b2f3a774defb870f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbab28318bf84c88b2f3a774defb870f"}]}] Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: bbab28318bf84c88b2f3a774defb870f Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1807413832 Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 9793a6256764417eb3ff1a8386368801 Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesSnapshotTestJSON-1807413832-project Sep 11 05:47:04.893025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '811bc271-657e-410b-9fb8-dfc4c0ca1880', 'id': 'd7a3a010-d9bf-430f-a952-d31b37daff59'} Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.893681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:04.894830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.896076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.897131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) Sep 11 05:47:04.898270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:04.900799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd9625ef-8075-48ba-90ec-404a077539c5) {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:04.900799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d8f2833-6deb-4361-984a-e6c6df123f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59" status: 400 len: 269 microversion: 2.1 time: 0.184093 Sep 11 05:47:04.900799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 662/1562] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:47:04 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880/os-volume_attachments/d7a3a010-d9bf-430f-a952-d31b37daff59 => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:47:04.900799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.903015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.909432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.910035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.910705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.910849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.911341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.912100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.912274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.912432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lazy-loading 'fault' on Instance uuid c4c14da8-f044-490c-86b4-f1cef62ed399 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:04.912744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.913398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.946673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-412ade77-e2b8-40a5-aed5-625ac3e77575 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051682 Sep 11 05:47:04.947504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 663/1563] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:04.952748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.955008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:04.961240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.962002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.962444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.963164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:04.963708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:04.964063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:04.966219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25cdba6a3bec49b4928b3fd953673060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd2ebaf054cfebad0bafa207f9967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:47:04.983209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a7f4c65-5fe7-4dfc-abce-16843aa9fd05 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 200 len: 1231 microversion: 2.1 time: 0.129098 Sep 11 05:47:04.984396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 901/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 1231 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:47:04.989252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:04.993376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:05.001977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.002218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3de84d5-f7e0-4a33-a5a9-2499795b8f76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053432 Sep 11 05:47:05.002859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.003312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.004084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.004672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 664/1565] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:05.009647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.011383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:05.011542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.012717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:05.020151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.020792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.021238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.022195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.022810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.023391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.054817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8b35ac0-ca66-4f9b-91d8-769b220c3cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Sep 11 05:47:05.055400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 665/1566] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:05.061137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d72e77f3-d6cf-494c-9cc2-9ccc9971437f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075378 Sep 11 05:47:05.061711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 902/1567] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:05.498808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:05.499631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:05.506216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.506804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.507313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.508136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.508696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.509251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.523922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] HTTP exception thrown: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Request method failure captured: Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 HTTP/1.1 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXLeDPuoFknL0Cc72wg0ARRSkkzkOXF1hYCcgjnMGPlv0lxSSjCBZS6RLZPgG8ox8lUCsGoNWLYI-ulzk3iLvxrEqFZ5wLjVJZPiKfd4oVsDiJRmOSzwYauVhztSekyc_lr8NhzgcfOt9tIJWUE800CS0Bw-80phjF8quOWj4ey5MfQ Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 183fd2ebaf054cfebad0bafa207f9967 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 05:47:05.525512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_183fd2ebaf054cfebad0bafa207f9967", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/183fd2ebaf054cfebad0bafa207f9967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/183fd2ebaf054cfebad0bafa207f9967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/183fd2ebaf054cfebad0bafa207f9967"}]}] Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 183fd2ebaf054cfebad0bafa207f9967 Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-TestVolumeBootPattern-533678925-project Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 25cdba6a3bec49b4928b3fd953673060 Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-TestVolumeBootPattern-533678925-project Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.527249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'c4c14da8-f044-490c-86b4-f1cef62ed399'} Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:05.528149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.530199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.532506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Returning 404 to user: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:05.532506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-243ad091-4729-4409-a4bc-46e4c577958d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 404 len: 111 microversion: 2.1 time: 0.032455 Sep 11 05:47:05.532506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 666/1568] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:47:05 2022] DELETE /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:47:05.538003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:05.538536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [instance: c4c14da8-f044-490c-86b4-f1cef62ed399] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:05.545232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.545726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.546205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.546855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.547395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.547895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.561875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] HTTP exception thrown: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Request method failure captured: Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 HTTP/1.1 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXLeDPuoFknL0Cc72wg0ARRSkkzkOXF1hYCcgjnMGPlv0lxSSjCBZS6RLZPgG8ox8lUCsGoNWLYI-ulzk3iLvxrEqFZ5wLjVJZPiKfd4oVsDiJRmOSzwYauVhztSekyc_lr8NhzgcfOt9tIJWUE800CS0Bw-80phjF8quOWj4ey5MfQ Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 183fd2ebaf054cfebad0bafa207f9967 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:47:05.563425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_183fd2ebaf054cfebad0bafa207f9967", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/183fd2ebaf054cfebad0bafa207f9967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/183fd2ebaf054cfebad0bafa207f9967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/183fd2ebaf054cfebad0bafa207f9967"}]}] Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 183fd2ebaf054cfebad0bafa207f9967 Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-TestVolumeBootPattern-533678925 Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-TestVolumeBootPattern-533678925-project Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 25cdba6a3bec49b4928b3fd953673060 Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-TestVolumeBootPattern-533678925-project Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.565076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c4c14da8-f044-490c-86b4-f1cef62ed399'} Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:05.565935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. Sep 11 05:47:05.567158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:05.568953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Returning 404 to user: Instance c4c14da8-f044-490c-86b4-f1cef62ed399 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:05.568953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dee59e01-934b-4b9a-818d-8facb544799d tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399" status: 404 len: 111 microversion: 2.1 time: 0.030959 Sep 11 05:47:05.568953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 903/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:47:05 2022] GET /compute/v2.1/servers/c4c14da8-f044-490c-86b4-f1cef62ed399 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 05:47:05.959482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:47:05.961656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:05.967799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.968302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.968737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.969419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:05.969867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:05.970286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:05.997459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [9f697aae-3d09-43dd-b142-4c6b9ef77065] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 05:47:06.018018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:47:06.020216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:06.026626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.027155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.027599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.028340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.028956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.029400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.129985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7b3e234-a3ca-4b5f-8005-150717da9f99 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action" status: 200 len: 82482 microversion: 2.1 time: 0.115867 Sep 11 05:47:06.130643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 904/1570] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:47:06 2022] POST /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/action => generated 82482 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:47:06.136023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:06.139166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:06.146193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.146681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.147122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.147826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.148320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.148754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.179881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7dce75dd-d517-4ef8-868e-9b8dca3af911 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047840 Sep 11 05:47:06.180463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 905/1571] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:06.185882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:06.187968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:06.193920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.194419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.194863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.195561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.196044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.196482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.226265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a6377ff-d56e-4867-9cae-cf9d8538d0d6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 11 05:47:06.226730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 906/1572] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:06.231161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:06.231885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:06.237343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.237825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.238260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.238944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:06.239401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:06.239848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:06.317980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lazy-loading 'services' on Instance uuid e812967c-7475-468f-a1c8-433fef2f929c {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 05:47:06.372711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Request method failure captured: Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments/5470d0e4-70e1-40c0-b38d-9b9becf69c4a HTTP/1.1 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXNN12t_Gz7bA74pwinq5yQHcVLUXad4EM6BN_VfIagPDyg7iAV_hRfvmjf1CmnjikzDlOLT579IkCP3IG-YJulZeAibRaJKToJfl2bQDnMZkSIXZgEYEi0XfNlcDVVw-qxmem4TK4tZVsNV_nm_OriM_07sAoyzn2pHHVSaGsIcQlM Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: da4ccd5b2fa14cd188de7c86f31d8632 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-TestMinimumBasicScenario-1546674314 Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 05:47:06.374986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da4ccd5b2fa14cd188de7c86f31d8632", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da4ccd5b2fa14cd188de7c86f31d8632"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da4ccd5b2fa14cd188de7c86f31d8632"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da4ccd5b2fa14cd188de7c86f31d8632"}]}] Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-TestMinimumBasicScenario-1546674314 Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: da4ccd5b2fa14cd188de7c86f31d8632 Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1546674314 Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-TestMinimumBasicScenario-1546674314-project Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: c9acda7a0d8c4834aace017083393cd0 Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-TestMinimumBasicScenario-1546674314-project Sep 11 05:47:06.376448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': 'e812967c-7475-468f-a1c8-433fef2f929c', 'id': '5470d0e4-70e1-40c0-b38d-9b9becf69c4a'} Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:06.377129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 05:47:06.378325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:06.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:06.381042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) Sep 11 05:47:06.382454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 05:47:06.383782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3bbc5a01-7c20-45af-a1c6-a1f45268f525) {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 05:47:06.383782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c90326c1-5316-4db3-9c5f-599e10c6255c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments/5470d0e4-70e1-40c0-b38d-9b9becf69c4a" status: 400 len: 269 microversion: 2.1 time: 0.148914 Sep 11 05:47:06.383782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 907/1573] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 05:47:06 2022] DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c/os-volume_attachments/5470d0e4-70e1-40c0-b38d-9b9becf69c4a => generated 269 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 05:47:07.005067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [9f697aae-3d09-43dd-b142-4c6b9ef77065] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55108. Sep 11 05:47:07.080962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74cd981c-16f6-4e72-8a1d-bcaaee203dae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/action" status: 200 len: 41150 microversion: 2.1 time: 1.124988 Sep 11 05:47:07.088244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 667/1574] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:47:05 2022] POST /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f/action => generated 41150 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:47:07.193209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:07.195294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:07.202043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:07.202532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:07.202969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:07.203660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:07.204165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:07.204589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:07.233298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-461a16e8-73c8-45cb-9ce9-8cffd750d71c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Sep 11 05:47:07.233851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 908/1575] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:07.239318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:07.241595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:07.249329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:07.249803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:07.250238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:07.250922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:07.251371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:07.251790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:07.281666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68b00497-8dd3-4073-9f8a-9e43e2339c56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046609 Sep 11 05:47:07.282199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 668/1576] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:08.245541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:08.248240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:08.254767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:08.255255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:08.255698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:08.256417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:08.256874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:08.257302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:08.286755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-219f1233-9ebb-4451-8887-1e2310aefe25 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 11 05:47:08.287306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 909/1577] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:08.294005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:08.296246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:08.302569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:08.303047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:08.303480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:08.304215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:08.304673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:08.305096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:08.335117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26ea7bf5-0232-4b5b-8dc5-e0dfeaf7397b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 11 05:47:08.335656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 669/1578] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:09.299889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:09.302063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:09.308397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:09.308881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:09.309320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:09.310011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:09.310573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:09.311040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:09.339895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e2ad4c3-9aa9-4ec0-b741-67216d90b61c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Sep 11 05:47:09.340476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 910/1579] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:09.348342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:09.350523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:09.356766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:09.357279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:09.357849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:09.358484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:09.358938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:09.359361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:09.388227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ecaeca7-0946-45aa-8a77-803800a73892 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Sep 11 05:47:09.389654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 670/1580] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:10.353192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:10.355443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:10.362525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:10.363005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:10.363464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:10.364183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:10.364634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:10.365055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:10.394632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f12953f-7294-40bd-b83d-e00156afd53e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Sep 11 05:47:10.395277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 911/1581] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:10.400812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:10.402978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:10.409551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:10.410027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:10.410460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:10.411134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:10.411600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:10.412014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:10.442913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b256183c-ad93-47ed-bfd0-764db91c4ea3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Sep 11 05:47:10.443445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 671/1582] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:11.407206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:11.409354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:11.415641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:11.416150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:11.416587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:11.417272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:11.417722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:11.418142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:11.447569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2687455-dade-443a-ad76-7491f6b28d08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Sep 11 05:47:11.448137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 912/1583] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:11.454902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:11.457085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:11.463183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:11.463659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:11.464123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:11.464808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:11.465263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:11.465681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:11.495162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d750e3ce-2176-412f-b26c-e00d56334310 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Sep 11 05:47:11.495704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 672/1584] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:12.460366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:12.462536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:12.468967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:12.469461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:12.469900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:12.470588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:12.471040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:12.471466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:12.496544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:12.502719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bf7f73d-b69d-4e8f-aece-8d446c8e65df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Sep 11 05:47:12.503275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 913/1585] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:12.507545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:12.509751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:12.516324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:12.516806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:12.517240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:12.517923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:12.518373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:12.518794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:12.548025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49cddec7-3c98-4ddd-b336-b6c6af952683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045127 Sep 11 05:47:12.548580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 673/1586] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:13.516288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:13.518502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:13.524729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:13.525205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:13.525635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:13.526316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:13.526764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:13.527188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:13.557202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-872e8a99-3e06-46fe-9320-03da7e136905 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Sep 11 05:47:13.557745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 914/1587] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:13.559899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:13.562659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:13.568989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:13.569475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:13.569916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:13.570609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:13.571063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:13.571490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:13.600997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bc2288ac-c854-4884-8968-887f5d5c4e35 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Sep 11 05:47:13.601546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 674/1588] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:14.570461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:14.572720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:14.580322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:14.580805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:14.581236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:14.581927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:14.582377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:14.582830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:14.613775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:14.614321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ad3b1a2-2000-4014-a7c1-5f222a83648e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 Sep 11 05:47:14.614817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 915/1589] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:14.615926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:14.622301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:14.622780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:14.623220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:14.623978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:14.624473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:14.624902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:14.653887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a269bf37-b3a5-4716-b775-00341297e66f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Sep 11 05:47:14.654433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 675/1590] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:15.626193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:15.628463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:15.634791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:15.635272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:15.635711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:15.636433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:15.636905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:15.637316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:15.666853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:15.667496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-607706a9-82dd-499a-8dfe-489ea9c74fc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Sep 11 05:47:15.667599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 916/1591] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:15.669080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:15.676429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:15.676918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:15.677357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:15.678062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:15.678517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:15.678945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:15.682632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:15.707682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96d080da-c61b-40a1-a4ca-9ae834c5664f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 11 05:47:15.708279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 676/1592] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:16.680137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:16.682402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:16.688999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:16.689482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:16.689929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:16.690656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:16.691117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:16.691549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:16.720915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-787b2e62-69d3-432a-b852-ac7c64ebbcea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Sep 11 05:47:16.721136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:16.721577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 917/1593] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:16.723148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:16.729565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:16.730043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:16.730479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:16.731200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:16.731654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:16.732099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:16.761285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7c43fad-260c-4038-b3cd-713048f268d8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Sep 11 05:47:16.761859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 677/1594] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:17.733766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:17.736072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:17.742361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:17.742839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:17.743270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:17.743956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:17.744431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:17.744858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:17.774361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2699790b-0656-4c6f-896e-97642b12babd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Sep 11 05:47:17.774600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:17.775117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 918/1595] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:17.776881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:17.783267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:17.783748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:17.784233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:17.784932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:17.785387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:17.785810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:17.816548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c703433d-3e70-46aa-b376-1b2c472a0f8a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045920 Sep 11 05:47:17.817108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 678/1596] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:18.786696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:18.789004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:18.795377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:18.795921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:18.796600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:18.797299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:18.797748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:18.798167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:18.828586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a559429-d0d5-4436-b500-64f7cf89a7b3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 11 05:47:18.829136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 919/1597] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:18.829769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:18.831919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:18.837833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:18.838309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:18.838742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:18.839426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:18.839874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:18.840322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:18.869344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b182914-cf46-4d41-bf0e-5a611b374fe2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Sep 11 05:47:18.869891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 679/1598] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:19.840783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:19.843764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:19.850204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:19.850683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:19.851117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:19.851800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:19.852277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:19.852698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:19.882244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:19.882797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddbb9955-6459-4c73-96db-0b1d6b6de040 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Sep 11 05:47:19.883295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 920/1599] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:19.884420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:19.891358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:19.891839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:19.892307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:19.893006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:19.893461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:19.893975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:19.923493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-954290b8-abe3-4eea-a14d-da683abd299b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Sep 11 05:47:19.924261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 680/1600] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:20.895773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:20.898065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:20.904513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:20.904998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:20.905477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:20.906402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:20.906856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:20.907280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:20.935797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:20.938727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:20.939280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a6ade63-b481-471e-859d-180da58fecd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047357 Sep 11 05:47:20.939852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 921/1601] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:20.945098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:20.945580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:20.946019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:20.946717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:20.947171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:20.947592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:20.976310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76a96732-4fa7-4ebb-afbf-1ba16e1de828 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Sep 11 05:47:20.976860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 681/1602] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:21.951470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:21.954589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:21.960847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:21.961331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:21.961764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:21.962448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:21.962935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:21.963355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:21.989493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:21.992242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:21.993394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9060c085-900d-4bb4-a98f-f4b7325c7d21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045744 Sep 11 05:47:21.995591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 922/1603] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:21.999145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:21.999990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:22.000463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:22.001260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:22.001789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:22.002217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:22.032938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a1c5129a-d78e-435c-ba26-d8da841f7dd8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Sep 11 05:47:22.033415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 682/1604] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:23.006185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:23.008624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:23.015357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:23.015939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:23.016503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:23.017273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:23.017741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:23.018174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:23.045390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:23.048531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-195b32c3-ce9c-4c45-ad8a-1531890eb949 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Sep 11 05:47:23.048678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:23.049095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 923/1605] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:23.054891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:23.055366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:23.055829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:23.056553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:23.057004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:23.057422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:23.086695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a4d08ea3-3f7a-4711-85d3-27399c8ae31a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Sep 11 05:47:23.087255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 683/1606] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:24.061263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:24.063731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:24.070178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:24.070664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:24.071102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:24.071797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:24.072282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:24.072712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:24.099505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:24.101869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:24.102650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a9d8e19-c9d4-4431-88b6-cc5cdf0fca3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 11 05:47:24.103209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 924/1607] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:24.107922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:24.108638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:24.109089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:24.109788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:24.110246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:24.110675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:24.139934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df4099f8-8f51-4b88-916c-076c020dc57e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Sep 11 05:47:24.140554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 684/1608] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:25.115487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:25.117797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:25.124203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:25.124647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:25.125086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:25.125786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:25.126248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:25.126672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:25.152668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:25.154843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:25.157450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4981ed9c-3f8b-4de1-a4e2-ac1d90acf930 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Sep 11 05:47:25.158020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 925/1609] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:25.161724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:25.162209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:25.162652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:25.163350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:25.163804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:25.164255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:25.193231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1cdcd80-a88b-4e62-bced-f93c3896386d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Sep 11 05:47:25.193815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 685/1610] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:26.169219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:26.172402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:26.178722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:26.179215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:26.179807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:26.180561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:26.180913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:26.181339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:26.205690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:26.207816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:26.211331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2009562-dec0-44a7-a178-6dc7f4c7404b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Sep 11 05:47:26.211897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 926/1611] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:26.214034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:26.214511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:26.214945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:26.215632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:26.216105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:26.216525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:26.245763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93e8bb76-631d-4e9d-a98e-b44c8fee11b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Sep 11 05:47:26.246304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 686/1612] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:27.224987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:27.227253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:27.229547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=61 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:27.235160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:27.235644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:27.236098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:27.236794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:27.237242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:27.237667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:27.258518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:27.260746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:27.263073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=57 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:27.269105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:27.269570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26cc4295-1f5e-4030-bbcb-0071b2eefca2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048453 Sep 11 05:47:27.269687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:27.270045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:27.270183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 927/1613] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:27.270813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:27.271352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:27.271790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:27.301295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b56b23d-9e80-4098-a50a-68868c128723 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Sep 11 05:47:27.301852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 687/1614] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:28.282467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:28.284770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:28.290977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:28.291469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:28.291907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:28.292633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:28.293091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:28.293532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:28.314197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:28.316405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:28.322944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:28.323427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:28.323862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:28.323974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff64368b-1d0c-4c8f-8a13-f17ed12f5ff5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Sep 11 05:47:28.324474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 928/1615] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:28.324616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:28.325029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:28.325641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:28.355303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48003daf-4695-454f-ab2d-eb3e73e5c434 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Sep 11 05:47:28.355853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 688/1616] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:29.336967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:29.339157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:29.346372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:29.346856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:29.347296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:29.348013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:29.348510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:29.348935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:29.368247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:29.371031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:29.377606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:29.378097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:29.378541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:29.378689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6381bac-edc5-4062-8227-22a072aa7b09 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Sep 11 05:47:29.379249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:29.379372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 929/1617] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:29.379784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:29.380338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:29.410406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64a44957-7fff-4ae7-856e-b9d989db1bbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Sep 11 05:47:29.410964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 689/1618] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:30.390976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:30.393273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:30.399643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:30.400056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:30.400496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:30.401189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:30.401670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:30.402093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:30.419421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:30.424760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:30.427628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:30.433481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:30.433957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:30.434364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec3edfa8-9a25-4f06-996f-5f1d80ca387a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047630 Sep 11 05:47:30.434493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:30.435106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 930/1619] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:30.435225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:30.435663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:30.436174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:30.468164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4663b894-2c0d-4a2c-86fb-fcfac574b51c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Sep 11 05:47:30.468992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 690/1620] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:31.447044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:31.449414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:31.455989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:31.456499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:31.456931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:31.457643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:31.458268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:31.458500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:31.488251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:31.488251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:31.488943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10175eab-7f73-46f6-8233-64cf4f1bbeb4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Sep 11 05:47:31.490050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 931/1621] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:31.490874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:31.491353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:31.491788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:31.492510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:31.492960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:31.493386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:31.523609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d1b6e365-a16c-408a-a987-90d3ce5c9c66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Sep 11 05:47:31.524184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 691/1622] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:32.501249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:32.503558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:32.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:32.510406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:32.510851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:32.511555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:32.512032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:32.512469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:32.536574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:32.538721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:32.544703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f429e59a-97be-40d7-a3d6-a086a6f555cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Sep 11 05:47:32.544861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:32.545273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 932/1623] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:32.545466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:32.545966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:32.546672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:32.547126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:32.547554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:32.573715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:32.580021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78485288-3d60-4adc-92a5-f40d0a9a2629 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Sep 11 05:47:32.580581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 692/1624] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:33.557432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:33.559699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:33.566392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:33.566870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:33.567304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:33.568014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:33.568468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:33.568891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:33.593191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:33.595490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:33.602146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:33.602631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:33.603067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:33.603763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:33.604245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:33.604379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51041cf0-5e60-43fa-94de-bfb0e38ca0a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050685 Sep 11 05:47:33.604909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:33.608794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 933/1625] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:33.634849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a45fe787-3319-4a21-ac7c-4888fe4cc15d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Sep 11 05:47:33.635398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 693/1626] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:34.617927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:34.620253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:34.626613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:34.627100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:34.627539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:34.628266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:34.628725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:34.629150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:34.647990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:34.650199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:34.657246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:34.657738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:34.658187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:34.658918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:34.659374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:34.659801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:34.674950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26d035a4-e11e-4b9a-aea2-f17ff9485b1a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060881 Sep 11 05:47:34.675655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 934/1627] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:34.689663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b418c835-ae5e-4cc7-b76c-584b29ff5513 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Sep 11 05:47:34.690228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 694/1628] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:35.687357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:35.689673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:35.696214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:35.696707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:35.697209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:35.697848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:35.698304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:35.698732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:35.702803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:35.705162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:35.712240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:35.712727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:35.713162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:35.713858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:35.714333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:35.714928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:35.730495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43b2bcc6-4f2a-4213-87c4-b27ef04831dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Sep 11 05:47:35.735265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 935/1629] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:35.746479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7887f577-ba64-41b8-be4f-d44fcd9803b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048131 Sep 11 05:47:35.747039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 695/1630] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:36.742630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:36.744946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:36.751560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:36.752074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:36.752519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:36.753222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:36.753687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:36.754120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:36.758855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:36.761021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:36.771908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:36.772467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:36.772858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:36.773561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:36.774014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:36.774437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:36.786071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83ecec5a-b22d-4581-8904-0d44f2c9637b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Sep 11 05:47:36.786657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 936/1631] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:36.806800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67d61e2d-c49b-4eef-b3c5-e376efcd7507 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051873 Sep 11 05:47:36.807370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 696/1632] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:37.799323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:37.801690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:37.808171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:37.808661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:37.809099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:37.809803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:37.810258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:37.810682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:37.818813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:37.821006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:37.827575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:37.828088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:37.828539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:37.829250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:37.829706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:37.830315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:37.843701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79317238-60d7-4405-8336-5dce6ca94a2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Sep 11 05:47:37.848451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 937/1633] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:37.866634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a3e0c5f-ca32-4bc6-993c-99461eb26fb4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051689 Sep 11 05:47:37.867192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 697/1634] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:38.856526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:38.858784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:38.865332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:38.865829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:38.866268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:38.866975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:38.867459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:38.867896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:38.879416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:38.881586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:38.887904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:38.888392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:38.889182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:38.890469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:38.891106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:38.891531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:38.899860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9da188a-0516-482a-a54b-3e42ea9d0cf4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Sep 11 05:47:38.902346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 938/1635] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:38.921921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd1ceb22-ce35-4323-9861-901606d70068 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046225 Sep 11 05:47:38.922478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 698/1636] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:39.912179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:39.914476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:39.921188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:39.921672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:39.922113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:39.922806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:39.923292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:39.923719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:39.934155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:39.936510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:39.943219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:39.943711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:39.944188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:39.944892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:39.945536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:39.945969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:39.956747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0996c49-b6c8-4a81-9aff-ebdc27a5db24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Sep 11 05:47:39.957334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 939/1637] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:39.977135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e7dbb15-7c5d-4ee5-88f2-3abd3a7f4be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046888 Sep 11 05:47:39.977709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 699/1638] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:40.969383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:40.971720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:40.978126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:40.978607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:40.979050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:40.979746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:40.980233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:40.980658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:40.989692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:40.991817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:40.998067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:40.999136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:40.999953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:41.000851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:41.001307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:41.001727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:41.013023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcf9ff9b-2ccb-48f2-9a4a-8cb24542b704 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Sep 11 05:47:41.014051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 940/1639] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:41.032917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-10c0e376-d019-48d4-b4ea-783bf882dbf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Sep 11 05:47:41.037649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 700/1640] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:42.025477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:42.027751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:42.034843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:42.035323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:42.035756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:42.036466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:42.036915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:42.037351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:42.044480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:42.046968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:42.053433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:42.053920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:42.054360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:42.055059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:42.055517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:42.055941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:42.067283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d51af32-bdb7-4dc7-9a72-4d55c70510d7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Sep 11 05:47:42.068140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 941/1641] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:42.090334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f22a57c2-a827-444a-b818-ebabd8a38163 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Sep 11 05:47:42.090899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 701/1642] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:43.078833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:43.081141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:43.087479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:43.087971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:43.088442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:43.089132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:43.089585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:43.090010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:43.102692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:43.104891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:43.111760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:43.112271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:43.112713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:43.113411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:43.113868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:43.114335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:43.122581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9aa41294-b93b-49d0-ab65-c53e800d0897 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Sep 11 05:47:43.123369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 942/1643] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:43.146463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd33d0ae-41c3-46d8-ab67-551bd4cf6017 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Sep 11 05:47:43.147368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 702/1644] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:44.136542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:44.139072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:44.148479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:44.148964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:44.149401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:44.150096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:44.150553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:44.150983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:44.158995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:44.161179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:44.167633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:44.168292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:44.168735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:44.169434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:44.169889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:44.170314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:44.181536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0f1ecd4-a37f-4880-b6aa-e75534754e85 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048887 Sep 11 05:47:44.182264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 943/1645] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:44.204946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-916c2f10-ff21-4f3d-8ff4-90de91350442 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050020 Sep 11 05:47:44.205515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 703/1646] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:45.194439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:45.196795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:45.203372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:45.203861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:45.204330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:45.205032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:45.205491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:45.205927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:45.217345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:45.219810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:45.226087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:45.226567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:45.227006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:45.227698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:45.228187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:45.228614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:45.236420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1b263c3-772e-490e-9830-40735d18f5c5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Sep 11 05:47:45.236990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 944/1647] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:45.260087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36487042-b81c-4436-a5fa-5e40485d6be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046575 Sep 11 05:47:45.260838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 704/1648] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:46.248946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:46.251860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:46.258292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:46.258782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:46.259221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:46.259910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:46.260397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:46.260827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:46.272826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:46.275036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:46.281466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:46.281952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:46.282392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:46.283096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:46.283582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:46.284030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:46.291565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31a7a418-a811-4ef2-bea1-4c574d124314 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Sep 11 05:47:46.292162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 945/1649] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:46.313635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22280ed1-dd5e-494f-b6ab-6f31f57b0a19 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 11 05:47:46.314196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 705/1650] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:47.304235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:47.306513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:47.313329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:47.313814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:47.314253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:47.315012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:47.315457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:47.315880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:47.325881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:47.328867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:47.335123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:47.335611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:47.336061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:47.336988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:47.337630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:47.338244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:47.347473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ea5c02f-c5d3-4670-8c24-cd51fd1abee1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Sep 11 05:47:47.348258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 946/1651] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:47.369627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f3fc751-5c03-471b-9710-36031e43cd67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047536 Sep 11 05:47:47.370193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 706/1652] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:48.360826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:48.363338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:48.370438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:48.370925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:48.371365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:48.372233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:48.372691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:48.373119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:48.377272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:48.382111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:48.384264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:48.391296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:48.391783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:48.392248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:48.392946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:48.393397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:48.393815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:48.404022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5263c7c1-dbb5-42ba-b992-28eb7c37426c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Sep 11 05:47:48.404583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 947/1653] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:48.425702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2c30e6e-2707-4e92-a467-2dcd8c3910f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Sep 11 05:47:48.426633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 707/1654] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:49.417001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:49.419374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:49.426413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:49.426840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:49.427280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:49.428030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:49.428478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:49.428903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:49.438491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:49.440667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:49.446891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:49.447373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:49.447812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:49.448548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:49.448999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:49.449427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:49.459731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55a7c67c-21d5-441e-89c3-d0066df439c8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046720 Sep 11 05:47:49.460329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 948/1655] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:49.478528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b74092dc-ef94-4bd0-9357-4d6bd60a54b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Sep 11 05:47:49.479067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 708/1656] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:50.472949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:50.475188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:50.486416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:50.486843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:50.487278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:50.488207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:50.488668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:50.489096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:50.492853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:50.495542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:50.502691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:50.503179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:50.503629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:50.504368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:50.504830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:50.505261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:50.522129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:50.522720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-657b2fbe-52de-4ebb-9aca-3ab11b115e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054739 Sep 11 05:47:50.523705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 949/1657] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:50.536565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6269f8c8-4b3f-444c-8cd6-3ae342c6fd1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049642 Sep 11 05:47:50.537125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 709/1658] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:51.535541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:51.538043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:51.544540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:51.544969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:51.545407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:51.546112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:51.546568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:51.547202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:51.551917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:51.554237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:51.559966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:51.560473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:51.560909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:51.561611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:51.562758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:51.563431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:51.578591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8859b099-b176-4206-b8c7-729b8297542e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047084 Sep 11 05:47:51.579170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 950/1659] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:51.593847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1bf865d-77e7-4147-8526-477e401b6ae4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Sep 11 05:47:51.594401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 710/1660] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:52.591558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:52.594802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:52.601376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:52.601790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:52.602226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:52.602932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:52.603386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:52.603816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:52.606719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:52.609081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:52.615461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:52.616044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:52.616574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:52.617337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:52.618260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:52.618688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:52.634078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-483aa1ae-9bfc-4c2b-b479-c7484811e9c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Sep 11 05:47:52.634837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 951/1661] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:52.648656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d4b4bde-02e9-4a54-824b-d9c97073c04d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Sep 11 05:47:52.649213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 711/1662] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:53.646853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:53.649165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:53.655320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:53.656362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:53.657102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:53.657807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:53.658457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:53.659137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:53.661705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:53.663840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:53.670557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:53.671046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:53.672101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:53.672818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:53.673281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:53.673712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:53.689745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2e6fd81-7741-4b07-bba1-4bd256926725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Sep 11 05:47:53.690315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 952/1663] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:53.703457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b345801f-7f05-436b-854c-20f528153a9d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Sep 11 05:47:53.704031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 712/1664] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:54.702486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:54.705696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:54.712323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:54.713025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:54.713656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:54.714577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:54.715218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:54.715833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:54.716729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:54.719312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:54.726422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:54.727175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:54.727795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:54.728542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:54.728998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:54.729550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:54.747647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0eb704cf-4d3e-4e09-a6d5-29fb0cdc214c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049349 Sep 11 05:47:54.748265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 953/1665] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:54.761531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67f3ed15-96cf-4953-b7f5-04dec9324f42 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049526 Sep 11 05:47:54.762117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 713/1666] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:55.760413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:55.762803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:55.770207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:55.770703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:55.771146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:55.771852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:55.772335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:55.772765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:55.781293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:55.783604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:55.789764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:55.790515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:55.790962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:55.791681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:55.792223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:55.792654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:55.803438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85982079-1319-4d92-935a-24b80e3c31e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046985 Sep 11 05:47:55.804030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 954/1667] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:55.823764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5cf408b-82fe-4c76-825a-a6f435e9bf0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Sep 11 05:47:55.824358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 714/1668] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:56.816450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:56.818736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:56.824825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:56.825314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:56.825757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:56.826453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:56.826901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:56.828039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:56.837401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:56.840204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:56.846678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:56.847166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:56.847603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:56.848323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:56.848779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:56.849207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:56.859937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44af24a2-f2be-4fd2-a22f-bd8bf2493dd1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Sep 11 05:47:56.860541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 955/1669] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:56.879298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7a0d881-1248-4518-a906-502df773edf0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Sep 11 05:47:56.879852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 715/1670] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:57.873059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:57.876342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:57.882694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:57.884265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:57.884792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:57.885229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:57.885930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:57.886511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:57.887050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:57.892788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:57.895524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:57.901749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:47:57.904777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:57.905280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:57.905752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:57.906480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:57.906943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:57.907374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:57.934237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6f6be12-7336-45cf-9480-885ac91a7b93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065993 Sep 11 05:47:57.934913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 956/1671] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:57.941200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51d372ab-84b4-4cb3-97f8-084362d4e3c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053365 Sep 11 05:47:57.941763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 716/1672] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:47:58.947032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:58.958680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:58.958795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:47:58.958795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:47:58.959356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:58.959356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:58.959356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:58.959356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:58.959968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:58.960721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:58.963333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:58.963814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:58.964283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:58.964980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:47:58.965436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:47:58.965897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:47:58.990923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-001b72b5-65ef-4641-bbf4-97d6379c5b46 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Sep 11 05:47:58.991496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 957/1673] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:47:58.994790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f371d856-8728-46a5-a5b3-6167d6764153 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Sep 11 05:47:58.995345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 717/1674] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:00.003576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:00.006108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:00.006915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:00.009122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:00.012608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:00.013099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:00.013534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:00.014492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:00.015790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:00.016292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:00.016432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:00.016838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:00.017278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:00.017988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:00.018434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:00.018858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:00.046078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70546d2f-8d77-4614-b895-e83065e0942f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Sep 11 05:48:00.046650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 958/1675] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:47:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:00.048881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e693d2aa-081e-47d4-86ca-c9feedf7e5d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Sep 11 05:48:00.049439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 718/1676] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:01.059158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:01.061548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:01.061669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:01.064271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:01.068472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:01.068965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:01.069408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:01.070261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:01.070722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:01.070906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:01.071151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:01.071351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:01.072043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:01.073150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:01.073726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:01.074277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:01.102376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4964e45-8058-4dad-aa77-740bdf9c4be2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Sep 11 05:48:01.102938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 959/1677] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:01.105107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe28d18c-5417-42f6-9c6f-0849c37a4912 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048626 Sep 11 05:48:01.105680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 719/1678] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:02.115820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:02.118165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:02.118586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:02.120284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:02.125342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:02.125836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:02.126276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:02.126986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:02.127444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:02.127873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:02.136207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:02.136807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:02.137474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:02.138184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:02.138674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:02.139369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:02.157728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38d5ec0e-a569-4be4-a187-cb2f2e240413 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Sep 11 05:48:02.158299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 960/1679] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:02.169400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a2caf58-5ec8-435f-af84-6224d31f7b6f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055105 Sep 11 05:48:02.169950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 720/1680] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:03.170527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:03.172959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:03.179883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:03.180407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:03.180845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:03.181549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:03.181990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:03.182343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:03.182854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:03.185334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:03.191713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:03.192236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:03.192681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:03.193451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:03.193913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:03.194341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:03.214524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85d19ed8-8c7b-470f-bd4f-d1aa0e85c230 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048017 Sep 11 05:48:03.215270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 961/1681] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:03.224639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bcf8bc18-11ff-4dd5-918e-2116ef1aa19f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Sep 11 05:48:03.225193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 721/1682] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:04.226857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:04.229161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:04.236681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:04.237179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:04.237629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:04.237933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:04.238384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:04.238777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:04.239206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:04.240118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:04.246802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:04.247293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:04.247737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:04.248471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:04.248931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:04.249360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:04.269757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de6bfb46-69db-49b0-a2ce-07de4dfa893a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Sep 11 05:48:04.270245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 962/1683] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:04.279290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-acd63839-9932-4e25-b4c1-06a94f7f0ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Sep 11 05:48:04.279836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 722/1684] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:05.282453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:05.284646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:05.291188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:05.291676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:05.292216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:05.292869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:05.293321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:05.293746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:05.293895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:05.298597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:05.306001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:05.306489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:05.306926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:05.307626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:05.308116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:05.308741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:05.322068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:05.328361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19d37527-05b7-4bec-9104-97dc15fdeb7a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Sep 11 05:48:05.328945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 963/1685] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:05.338950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75f5fce3-f91d-48ae-b964-4854354c8e5f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Sep 11 05:48:05.339788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 723/1686] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:06.340763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:06.343538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:06.350455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:06.351418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:06.351860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:06.351987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:06.352589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:06.353041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:06.353462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:06.354087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:06.361645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:06.362222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:06.362727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:06.363582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:06.364054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:06.364481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:06.385380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a558011-7c57-4d0f-9ae5-b317e425115e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Sep 11 05:48:06.385938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 964/1687] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:06.395602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c70eb526-d2fc-46b5-b587-d68cf7684316 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Sep 11 05:48:06.396168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 724/1688] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:07.398773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:07.400932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:07.408651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:07.410419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:07.410827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:07.411238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:07.411988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:07.413214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:07.413956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:07.414657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:07.419603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:07.419934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:07.420402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:07.421120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:07.421584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:07.422223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:07.451264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f9d90c6-ec9f-41e5-8b91-ddab16bba118 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055764 Sep 11 05:48:07.451264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 965/1689] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:07.463127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e67e16ce-3e31-4ed4-91db-a269b8260ccb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059066 Sep 11 05:48:07.463975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 725/1690] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:08.462621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:08.464851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:08.473271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:08.473826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:08.474281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:08.474998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:08.475457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:08.475930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:08.482848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:08.487016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:08.495423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:08.496325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:08.497501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:08.498710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:08.500039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:08.500663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:08.508913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b1f5976-0b33-4076-bd1f-05b1e60adf36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050126 Sep 11 05:48:08.509751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:08.514441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 966/1691] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:08.536950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d192340-75ee-4fd2-86cc-c9076faaefdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063609 Sep 11 05:48:08.537511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 726/1692] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:09.521647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:09.523791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:09.530214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:09.530703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:09.531805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:09.532542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:09.533003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:09.533435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:09.551049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:09.554025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:09.560173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:09.560656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:09.561091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:09.561781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:09.562428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:09.563136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:09.575084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-950f2564-e38d-4567-8709-63723c35445b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057137 Sep 11 05:48:09.575905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 967/1693] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:09.594156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99f065f9-f0ea-469e-b8f2-cbefd4181ecf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048020 Sep 11 05:48:09.595196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 727/1694] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:10.587755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:10.590009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:10.591986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:48:10.592164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:48:10.598851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:10.599340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:10.599779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:10.600507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:10.600964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:10.601752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:10.608038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:10.611053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:10.618063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:10.618614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:10.618905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:10.619640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:10.620116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:10.620544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:10.634238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7afc891c-f658-4d1c-89b2-374d40f85b38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050397 Sep 11 05:48:10.635135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 968/1695] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:10.652491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7dfafdd1-05cb-4747-9d2b-6dba01d99470 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048567 Sep 11 05:48:10.653058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 728/1696] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:11.647852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:11.650016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:11.656421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:11.656904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:11.657539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:11.658443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:11.658897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:11.659321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:11.665082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:11.667391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:11.673846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:11.674589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:11.675032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:11.675818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:11.676379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:11.676744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:11.692099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-238302ee-2a1e-4943-90b8-c8bb54f1e098 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048322 Sep 11 05:48:11.692669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 969/1697] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:11.710430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c95f5c3f-8dbd-4fcc-9528-e896eea33143 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049344 Sep 11 05:48:11.711009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 729/1698] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:12.705221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:12.707396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:12.713972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:12.714453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:12.714889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:12.715577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:12.716063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:12.716491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:12.724572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:12.726816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:12.733368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:12.733855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:12.734288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:12.734981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:12.736397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:12.736973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:12.749558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b68da9e2-c698-47ad-8c74-5a6ec819125c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048845 Sep 11 05:48:12.755195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 970/1699] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:12.774092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5d478f43-be21-4111-97dc-16c35f5a3798 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055038 Sep 11 05:48:12.778938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 730/1700] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:13.761733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:13.763925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:13.771357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:13.771845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:13.772322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:13.773018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:13.773476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:13.773901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:13.786692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:13.792247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:13.799026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:13.799450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:13.800289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:13.800981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:13.801464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:13.801883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:13.806603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49acfb6a-e8fb-4752-86b0-9b699f9e9f53 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 Sep 11 05:48:13.811124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 971/1701] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:13.834059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83b8a69d-29c7-4098-8e10-8f640b5a83b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051395 Sep 11 05:48:13.834786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 731/1702] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:14.818660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:14.820870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:14.827245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:14.827736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:14.828215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:14.828913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:14.829374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:14.830314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:14.848352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:14.850462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:14.857624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:14.857875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:14.858323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:14.859039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:14.859501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:14.859942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:14.863099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8c8fd4d-dcc8-4a60-a64c-110d610242e1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Sep 11 05:48:14.863813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 972/1703] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:14.894590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ada45c6f-6fd5-4b05-93c7-c636d22930aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052063 Sep 11 05:48:14.895382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 732/1704] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:15.875738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:15.878715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:15.885043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:15.885523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:15.885961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:15.886647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:15.887102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:15.887523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:15.907044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:15.909592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:15.916886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:15.916886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:15.917229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:15.917872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:15.918325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:15.918753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:15.919120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f2b937e-18b8-4985-92b7-54df8020e1d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Sep 11 05:48:15.919917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 973/1705] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:15.956640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e373928-b00d-4581-bbdc-3a66a3edd035 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Sep 11 05:48:15.956640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 733/1706] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:16.932112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:16.934266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:16.941409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:16.941904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:16.942321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:16.943056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:16.943474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:16.943900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:16.962897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:16.965115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:16.971947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:16.972334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:16.972776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:16.973480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:16.974175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:16.974615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:16.976489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f191fcef-5a80-4236-9746-36144a825352 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048222 Sep 11 05:48:16.977257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 974/1707] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:17.006587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0739158f-d0f6-49ec-97c2-7c69a6ae0a57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048297 Sep 11 05:48:17.007384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 734/1708] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:17.989476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:17.991662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:17.993648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:48:17.993778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:48:18.000121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:18.000605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:18.001046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:18.001854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:18.002311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:18.002737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:18.019610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:18.021901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:18.028701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:18.029196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:18.029977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:18.030342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:18.030806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:18.031238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:18.035911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ff6bbb6-53e4-4d6a-b328-868520ad3e45 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050454 Sep 11 05:48:18.037813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 975/1709] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:18.066336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa6dfbd2-69ef-4dba-886f-e085bc3f2081 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051219 Sep 11 05:48:18.067116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 735/1710] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:19.049062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:19.051225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:19.057603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:19.058028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:19.058469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:19.059160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:19.059623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:19.060072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:19.078181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:19.080443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:19.086693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:19.087279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:19.087685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:19.088414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:19.088874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:19.089066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9c7cb16-cdc9-42dd-8510-10c7a1c5bcba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Sep 11 05:48:19.089425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:19.093167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 976/1711] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:19.120325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4391bc9d-2fef-478f-be1c-36bc96d52e87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Sep 11 05:48:19.120888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 736/1712] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:20.100616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:20.102812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:20.109224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:20.109712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:20.110152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:20.111414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:20.111876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:20.112344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:20.132914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:20.135085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:20.141791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:20.142817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:20.143213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d4ebebf-7a52-4635-9a7e-a34eb72e2ae5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Sep 11 05:48:20.143350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:20.143783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 977/1713] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:20.143932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:20.144413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:20.144839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:20.174823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ee43e27-8b0d-4337-9c6e-ce9c72c31f57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Sep 11 05:48:20.175383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 737/1714] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:21.155434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:21.157713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:21.164072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:21.164558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:21.165003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:21.165693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:21.166151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:21.166579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:21.186623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:21.189505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:21.196024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:21.196499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:21.196941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:21.197184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5492dfe1-1e32-4cbc-a436-b98f2d205770 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Sep 11 05:48:21.197627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:21.201983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 978/1715] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:21.202123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:21.202123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:21.229095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fa64bdf-4ab9-463b-903f-4e5c9314179a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046310 Sep 11 05:48:21.229664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 738/1716] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:22.210446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:22.212631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:22.219088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:22.219579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:22.220290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:22.221020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:22.221479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:22.221911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:22.241349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:22.243549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:22.249852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:22.250347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:22.250763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:22.251019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e2add19-1053-4335-8830-1c0e2b14abcf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Sep 11 05:48:22.252007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:22.252128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 979/1717] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:22.252768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:22.253197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:22.283743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1facf7fc-560c-4383-a74c-3d99d14bb84b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Sep 11 05:48:22.284344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 739/1718] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:23.264446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:23.266554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:23.273411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:23.273891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:23.274331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:23.275020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:23.275474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:23.275899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:23.292984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:23.297023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:23.299380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:23.305633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:23.306117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:23.306553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:23.306867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c48e3727-2d59-484d-a6e4-462e54b05ad0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046730 Sep 11 05:48:23.307240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:23.307430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 980/1719] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:23.307690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:23.308213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:23.337868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7467f18-35dd-45b3-8e4d-c742ff7f3dfa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 11 05:48:23.338425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 740/1720] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:24.319761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:24.321896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:24.328315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:24.328798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:24.329870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:24.330720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:24.331177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:24.331601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:24.349536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:24.351804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:24.358133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:24.358611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:24.359045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:24.359735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:24.360221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:24.360444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4f23c74-2f02-4d97-84fc-3ec82663462f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Sep 11 05:48:24.360794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:24.361046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 981/1721] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:24.391453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-afcc4bae-771f-4bc2-bdaa-5fca82b77c03 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Sep 11 05:48:24.392599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 741/1722] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:25.373147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:25.375261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:25.382149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:25.382626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:25.383064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:25.383746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:25.384221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:25.384641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:25.404332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:25.406525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:25.413363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:25.413854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:25.414298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:25.415004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:25.415464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:25.415896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:25.416032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b438588-5e6e-40ce-9d21-027041a93c65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Sep 11 05:48:25.416590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 982/1723] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:25.440766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:25.445933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23317a28-8c6d-4d9f-83d1-90d9cf9e8ddb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Sep 11 05:48:25.446646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 742/1724] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:26.429050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:26.431247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:26.437717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:26.438204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:26.439447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:26.440179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:26.440645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:26.441075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:26.458877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:26.461071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:26.467284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:26.467761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:26.468242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:26.468925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:26.469373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:26.470485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:26.470786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0484eccb-8521-4c72-99ca-2005e82f670e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Sep 11 05:48:26.471355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 983/1725] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:26.501186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee52154a-cb87-41c0-8e96-ef30922764fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Sep 11 05:48:26.501782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 743/1726] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:27.483211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:27.485503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:27.492071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:27.492549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:27.492981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:27.493660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:27.494116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:27.494535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:27.513647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:27.516104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:27.523043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:27.523533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:27.523958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:27.524681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:27.525131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:27.525555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:27.525656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f3d2987-a5df-426f-a031-9082900f9b89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046324 Sep 11 05:48:27.526151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 984/1727] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:27.554922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-832531c5-16b9-412e-9999-00062cb18535 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 11 05:48:27.555477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 744/1728] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:28.538322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:28.540659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:28.542946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:28.549031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:28.549735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:28.550382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:28.551383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:28.552142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:28.552829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:28.566929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:28.569093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:28.571387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:28.576421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:28.576904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:28.577337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:28.578035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:28.578485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:28.578906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:28.584690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29fc2a5a-e0a4-49f2-907d-917f8a54943e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050385 Sep 11 05:48:28.585265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 985/1729] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:28.609654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85440577-bb49-44c2-bc41-4e1107f641dc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Sep 11 05:48:28.610210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 745/1730] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:29.597453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:29.599626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:29.605563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:29.606047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:29.606488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:29.607185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:29.607642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:29.608102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:29.622284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:29.624525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:29.630947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:29.631432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:29.631873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:29.632622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:29.633082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:29.633509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:29.638194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edaf84a2-8b25-4d56-9657-24daab50a0c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Sep 11 05:48:29.638760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 986/1731] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:29.663720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e0bc933-4303-4c64-abfa-27c35bfaaf91 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Sep 11 05:48:29.664303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 746/1732] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:30.651263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:30.653440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:30.659986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:30.660495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:30.660937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:30.661631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:30.662087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:30.662513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:30.676101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:30.678280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:30.684970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:30.685451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:30.685883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:30.686578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:30.687032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:30.687451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:30.692896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebb309dc-56c7-41a6-a377-bfa74f7d697b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Sep 11 05:48:30.693460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 987/1733] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:30.717770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-21a18a9a-abbb-40ef-ba78-1a13b97ac66e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Sep 11 05:48:30.718319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 747/1734] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:31.705794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:31.708033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:31.714528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:31.715019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:31.715489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:31.716223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:31.716686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:31.717118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:31.730299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:31.732532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:31.738973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:31.739846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:31.740234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:31.740943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:31.741402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:31.741826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:31.746728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ea8a579-5dcc-45c1-89c3-1f489af77b97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Sep 11 05:48:31.747299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 988/1735] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:31.772518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5fb15902-d8b9-4ef4-a29a-1b3c88ed1ee5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Sep 11 05:48:31.773077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 748/1736] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:32.759985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:32.762189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:32.769459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:32.769949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:32.770392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:32.771087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:32.771551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:32.771980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:32.783867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:32.786080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:32.792479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:32.792972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:32.793416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:32.794127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:32.794588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:32.795015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:32.802301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-743c9eba-8241-416b-a65a-4c9b5030a8ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046202 Sep 11 05:48:32.802874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 989/1737] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:32.828184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81baea78-1000-4d68-b4ee-2b4a5b781c0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Sep 11 05:48:32.828739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 749/1738] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:33.815387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:33.817562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:33.824145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:33.824638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:33.825083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:33.825780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:33.826242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:33.826673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:33.840738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:33.843067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:33.849621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:33.850111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:33.850556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:33.851268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:33.851728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:33.852199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:33.858681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-581f74b3-0fd9-46aa-9347-e8434065b4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Sep 11 05:48:33.859243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 990/1739] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:33.882433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17082a17-41e9-4bd0-aedd-66a037778096 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Sep 11 05:48:33.882996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 750/1740] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:34.872167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:34.874300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:34.881565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:34.882046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:34.882483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:34.883171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:34.883623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:34.884068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:34.895817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:34.897990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:34.904323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:34.904806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:34.905243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:34.905942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:34.906397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:34.906825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:34.914994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6dda386-caa3-4e4e-8b9f-6142a2122b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 Sep 11 05:48:34.915551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 991/1741] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:34.935798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-579f271d-1bb7-4d1d-a2b9-3c24322cef3a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Sep 11 05:48:34.936375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 751/1742] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:35.927462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:35.929633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:35.935951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:35.936460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:35.936894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:35.937577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:35.938026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:35.938550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:35.947984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:35.950152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:35.956984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:35.957684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:35.958135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:35.958843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:35.959308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:35.959748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:35.970811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b326afde-db89-49ea-bddf-8f21988f31f1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047259 Sep 11 05:48:35.971378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 992/1743] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:35.989608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3719cf17-3be6-4c5f-a865-aeb2721d16dd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Sep 11 05:48:35.990165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 752/1744] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:36.982738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:36.984945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:36.991408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:36.991886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:36.992352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:36.993044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:36.993518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:36.993947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:37.002297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:37.004462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:37.010770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:37.011257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:37.011701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:37.012442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:37.012900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:37.013332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:37.024346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-893be751-47fc-4407-a522-223fd2ceb8d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Sep 11 05:48:37.024912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 993/1745] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:37.043268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dff19dd3-ea5d-4f26-9d78-a386836cb1b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Sep 11 05:48:37.043827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 753/1746] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:38.037353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:38.039512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:38.046113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:38.046592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:38.047026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:38.048546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:38.049168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:38.049605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:38.055174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:38.057493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:38.063732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:38.064276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:38.064725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:38.066409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:38.066530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:38.066893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:38.081145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebcf8244-5044-4d4b-b2af-97fc601ee72e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Sep 11 05:48:38.081997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 994/1747] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:38.097301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58239c29-9047-4b12-b867-537a84d8a5c4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Sep 11 05:48:38.097867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 754/1748] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:39.093653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:39.096108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:39.102501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:39.102979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:39.103412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:39.104133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:39.104590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:39.105012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:39.109442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:39.112230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:39.118455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:39.118937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:39.119371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:39.120084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:39.120539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:39.120958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:39.135621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c2308ce-81e1-4264-b141-48c9eaf27d81 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Sep 11 05:48:39.136489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 995/1749] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:39.151821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e813568-9409-49fa-8b7c-e6e25ecf7539 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046224 Sep 11 05:48:39.152434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 755/1750] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:40.149512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:40.151637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:40.158316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:40.158808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:40.159241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:40.159940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:40.160419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:40.160845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:40.163191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:40.165369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:40.171680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:40.172212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:40.172679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:40.173377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:40.173840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:40.174271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:40.192386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2b31346-700c-4563-a26a-140f84aeea99 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Sep 11 05:48:40.192959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 996/1751] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:40.203811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7b94d82-0c44-489a-9125-74e695b4c696 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Sep 11 05:48:40.204395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 756/1752] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:41.203876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:41.206919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:41.213395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:41.213921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:41.214367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:41.215074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:41.215566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:41.216024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:41.216821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:41.218973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:41.219877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:41.226539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:41.227031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:41.227464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:41.228206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:41.228696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:41.229117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:41.262130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9618d4b-7e23-46a3-bd47-e74b8d7620de tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049150 Sep 11 05:48:41.262728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 757/1753] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:41.399795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c5cf2e8-a928-480a-aa57-301842036db2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199820 Sep 11 05:48:41.400389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 997/1754] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:42.274675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:42.276879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:42.283283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:42.283800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:42.284269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:42.284964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:42.285416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:42.285842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:42.314142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60dc71ab-aeab-4ddb-a1cd-07263502f832 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Sep 11 05:48:42.315205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 758/1755] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:42.411782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:42.414898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:42.423242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:42.436069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:42.436069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:42.436069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:42.436069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:42.437112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:42.458561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54649f61-be5c-4bdf-8b25-87fd9c8e4804 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050782 Sep 11 05:48:42.459132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 998/1756] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:43.326929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:43.329092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:43.336164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:43.336643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:43.337076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:43.337761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:43.338210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:43.338630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:43.355475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:43.369061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce46c7eb-361a-466c-90d3-78fd6c247ebf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Sep 11 05:48:43.369610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 759/1757] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:43.471307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:43.473519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:43.479499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:43.479984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:43.480439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:43.481126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:43.481573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:43.481996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:43.513097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65b68922-8a6c-4473-8fd3-efa64f86ebfe tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Sep 11 05:48:43.513647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 999/1758] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:44.381893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:44.384063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:44.390646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:44.391130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:44.391573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:44.392309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:44.393007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:44.393443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:44.422747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a08c5ab-54be-4ec1-9115-a03833f1553a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Sep 11 05:48:44.423303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 760/1759] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:44.526583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:44.528688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:44.535614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:44.536147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:44.536583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:44.537272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:44.537730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:44.538151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:44.568521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97293589-4813-4d20-bd1c-181e55ccfe36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Sep 11 05:48:44.569070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1000/1760] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:45.435900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:45.438088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:45.444952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:45.445428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:45.445863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:45.446552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:45.447007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:45.447432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:45.477702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2be95717-730d-47fc-bdbb-aca4c2913aad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Sep 11 05:48:45.478257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 761/1761] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:45.583135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:45.585213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:45.591684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:45.592203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:45.592640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:45.593332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:45.593782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:45.594204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:45.624988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82c86212-0667-48f4-b7f1-ea507bd0c8f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Sep 11 05:48:45.625546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1001/1762] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:46.490710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:46.492887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:46.499238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:46.499719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:46.500193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:46.500893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:46.501353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:46.501782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:46.531553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-375608a7-6646-4b1e-99a3-781bb16f0386 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Sep 11 05:48:46.532127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 762/1763] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:46.638047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:46.640829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:46.647088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:46.647680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:46.648143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:46.648838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:46.649289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:46.649760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:46.681922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9068a106-d800-41a6-b8e4-fbbdc5459a59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Sep 11 05:48:46.682476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1002/1764] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:47.543364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:47.545552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:47.551943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:47.552453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:47.552892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:47.553585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:47.554039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:47.554463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:47.584285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d321c779-a20b-4d16-9cef-de3d38cdfb58 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Sep 11 05:48:47.584841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 763/1765] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:47.694884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:47.697104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:47.703510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:47.703947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:47.704426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:47.705135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:47.705596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:47.706026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:47.740206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fde39d9-9df7-42fe-8ebf-6441bb2faa01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 Sep 11 05:48:47.740946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1003/1766] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:48.596398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:48.599197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:48.605526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:48.606010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:48.606451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:48.607151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:48.607609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:48.608061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:48.636334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6052e23a-d2b0-432a-8069-34034a3eed8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Sep 11 05:48:48.636886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 764/1767] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:48.752065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:48.754563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:48.760873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:48.761361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:48.761798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:48.762500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:48.762953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:48.763380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:48.794607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9da87857-10dc-4725-9464-c3953ba74fe0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 11 05:48:48.795466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1004/1768] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:49.649122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:49.651275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:49.657718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:49.658209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:49.658653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:49.659902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:49.660441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:49.660822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:49.690366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c26549e-5afa-48a8-828c-4cfe37f06efc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Sep 11 05:48:49.690963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 765/1769] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:49.807370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:49.810027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:49.816261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:49.816746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:49.817183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:49.817949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:49.818343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:49.818770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:49.848441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d6bcaef-52eb-445a-bee0-798c23d916e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Sep 11 05:48:49.848993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1005/1770] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:50.702654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:50.704832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:50.711695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:50.712209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:50.712646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:50.713323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:50.713770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:50.714192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:50.742709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ebdbb35d-794c-41e0-9bb8-d318fcd2ce83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Sep 11 05:48:50.743245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 766/1771] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:48:50.860267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:50.863172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:50.869716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:50.870185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:50.870623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:50.871309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:50.871756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:50.872209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:50.903923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f156ce0-c06a-423e-8425-b5dd38994729 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047650 Sep 11 05:48:50.904506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1006/1772] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:51.755704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:51.757869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:51.765005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:51.765490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:51.765925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:51.766612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:51.767065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:51.767486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:51.797284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce9a2904-6f54-4441-afc2-1f4592c12e9b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 Sep 11 05:48:51.797851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 767/1773] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:51.916814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:51.919012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:51.926162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:51.926645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:51.927092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:51.927791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:51.928274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:51.928731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:51.958171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5acde8f6-f0df-4d47-bbbe-91ec26e9a64c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Sep 11 05:48:51.958730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1007/1774] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:52.810592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:52.812779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:52.819630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:52.820153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:52.820592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:52.821280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:52.821733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:52.822155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:52.853782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1894aba5-4a0d-4d69-b833-c26ba9922c88 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Sep 11 05:48:52.854352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 768/1775] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:52.970598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:52.973486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:52.979825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:52.980337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:52.980771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:52.981457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:52.981909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:52.982333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:53.013138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7a60b75-e571-4350-9a21-e519bd3e4499 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Sep 11 05:48:53.013690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1008/1776] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:53.866683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:53.868883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:53.875193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:53.875683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:53.876160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:53.876864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:53.877323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:53.877751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:53.907714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aee2f7e7-5a85-4d7b-ab24-91ce7a601d4d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Sep 11 05:48:53.908310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 769/1777] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:54.025824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:54.028018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:54.034978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:54.035462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:54.035900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:54.036622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:54.037079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:54.037534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:54.066811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11503da4-c61d-4817-9d28-d5e87bd85275 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Sep 11 05:48:54.067371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1009/1778] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:54.920809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:54.922996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:54.930091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:54.930576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:54.931017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:54.931713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:54.932208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:54.932642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:54.961440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d8b38dc-7cc0-47f2-b713-92128430a6e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Sep 11 05:48:54.961901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 770/1779] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:55.079261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:55.081855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:55.088157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:55.088640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:55.089075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:55.089764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:55.090213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:55.090633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:55.123363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-173b9911-5127-457e-8234-82ceb7d3c159 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048036 Sep 11 05:48:55.123927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1010/1780] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:55.974177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:55.976392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:55.983355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:55.983835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:55.984306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:55.985001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:55.985462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:55.985885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:56.015111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9969e523-0cc5-4751-994e-8343a224847c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Sep 11 05:48:56.015662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 771/1781] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:56.135371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:56.137570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:56.145189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:56.145681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:56.146121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:56.146823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:56.147283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:56.147718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:56.177676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-357cccc0-c2f2-45b6-864f-32223ea5bb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Sep 11 05:48:56.178236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1011/1782] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:57.028147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:57.030321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:57.037928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:57.038482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:57.038935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:57.039642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:57.040210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:57.040642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:57.071272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3325a39-dde4-459a-9d90-bdd70c275c1f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Sep 11 05:48:57.071829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 772/1783] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:57.190086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:57.192940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:57.199318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:57.199804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:57.200341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:57.201039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:57.201500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:57.201932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:57.232084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad0f721b-bb58-4af3-83f3-7ebcb5012926 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Sep 11 05:48:57.232650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1012/1784] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:58.083980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:58.086154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:58.092660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:58.093141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:58.093572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:58.094267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:58.094717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:58.095138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:58.124263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b98582f-150b-487b-8ed0-cc57739190f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Sep 11 05:48:58.124813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 773/1785] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:58.244540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:58.246720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:58.253077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:58.253565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:58.254010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:58.254706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:58.255163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:58.255593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:58.280628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:58.286515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4d384b1-e6b6-4d00-a8df-f5cc489576aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Sep 11 05:48:58.287081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1013/1786] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:59.137546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:59.140074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:59.142362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:59.148160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:59.148653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:59.149094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:59.149852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:59.150368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:59.150867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:59.181260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-015ab322-2da8-42ed-9dbe-6cf5dbe93b93 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Sep 11 05:48:59.181810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 774/1787] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:48:59.299355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:48:59.301454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:48:59.303274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:48:59.308441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:59.308933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:59.309377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:59.310078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:48:59.310540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:48:59.310967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:48:59.340545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6e9f9fb-974f-4f9a-8334-a46a81b50673 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Sep 11 05:48:59.341110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1014/1788] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:48:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:00.193907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:00.196176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:00.202198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:00.202682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:00.203118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:00.203811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:00.204287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:00.204734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:00.235219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81a38bd5-04cd-48e3-9537-8792870653f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 11 05:49:00.235773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 775/1789] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:00.352602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:00.354947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:00.361100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:00.361578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:00.362028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:00.362774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:00.363285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:00.363909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:00.396549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0eb3ee3a-9781-45ae-ab7d-b25141ffb3de tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047880 Sep 11 05:49:00.397182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1015/1790] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:01.248866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:01.251002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:01.257559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:01.258034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:01.258468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:01.259156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:01.259604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:01.260044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:01.263536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:01.290885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ecd1671f-f8e9-4a9d-a736-354c27d0b72a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Sep 11 05:49:01.291436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 776/1791] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:01.410275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:01.412440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:01.419172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:01.419652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:01.420115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:01.420804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:01.421258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:01.421681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:01.450387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f09dfc38-24f9-4d9a-b644-e558184aedc2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Sep 11 05:49:01.450925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1016/1792] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:02.303331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:02.305540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:02.311898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:02.312424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:02.312882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:02.313569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:02.314028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:02.314450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:02.344726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-33730e73-0119-4f5b-a66e-169a7d25de7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046022 Sep 11 05:49:02.345278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 777/1793] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:02.463081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:02.465328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:02.471731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:02.472255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:02.472694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:02.473386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:02.473841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:02.474284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:02.503362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-486ee71c-2632-430c-b8bc-7abcbda0d93e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Sep 11 05:49:02.503901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1017/1794] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:03.357970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:03.360163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:03.367595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:03.368116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:03.368622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:03.369323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:03.369776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:03.370197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:03.400813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad68ba90-2c44-4f30-967f-29d8f960112f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046774 Sep 11 05:49:03.401403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 778/1795] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:03.516071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:03.518729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:03.525164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:03.525643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:03.526076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:03.526756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:03.527209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:03.527634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:03.557000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd7edc48-1120-4785-83ab-4bb1dbda361b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Sep 11 05:49:03.557543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1018/1796] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:04.414614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:49:04.416815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:04.422761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:04.423237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:04.423671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:04.424385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:04.424865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:04.425286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:04.526597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd17aec0-9f70-450b-ab37-7f14182e86a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action" status: 200 len: 75980 microversion: 2.1 time: 0.116969 Sep 11 05:49:04.527269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 779/1797] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:49:04 2022] POST /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5/action => generated 75980 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 05:49:04.569946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:04.572149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:04.578646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:04.579133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:04.579573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:04.580289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:04.580745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:04.581782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:04.611278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c13a145-bd1c-4ff5-820a-b1dc468db48b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 11 05:49:04.611827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1019/1798] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:05.624985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:05.627221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:05.633952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:05.634437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:05.634877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:05.635578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:05.636051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:05.636474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:05.666974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48c06479-460e-4c1f-ad59-a3cf664e250e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Sep 11 05:49:05.667518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 780/1799] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:06.679820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:06.682051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:06.688680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:06.689167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:06.689613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:06.690309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:06.690767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:06.691193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:06.720949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42af9c47-8b59-48ee-892f-8a4739210dbb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Sep 11 05:49:06.721493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1020/1800] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:07.733619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:07.735787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:07.742823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:07.743312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:07.743748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:07.744477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:07.744931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:07.745385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:07.775291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0faac8f4-f100-48f9-a449-6523fbf94411 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Sep 11 05:49:07.775846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 781/1801] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:08.787930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:08.790095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:08.796708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:08.797115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:08.797551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:08.798377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:08.798832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:08.799250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:08.831305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-263b1284-66d5-4c9a-bf19-addaaec9702f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047432 Sep 11 05:49:08.831853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1021/1802] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:09.842531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:09.844799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:09.852868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:09.853347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:09.853779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:09.854477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:09.854923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:09.855345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:09.888990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-673c8e94-cf5b-491d-bd8e-a43b0b8fd04c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050261 Sep 11 05:49:09.889960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 782/1803] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:10.902473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:10.904653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:10.911186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:10.911677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:10.912139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:10.913473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:10.913929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:10.914358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:10.945076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fc684ed-2096-43ee-9b29-b6b072664b6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Sep 11 05:49:10.945640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1022/1804] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:11.957766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:11.960670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:11.966939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:11.967423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:11.967860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:11.968587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:11.969055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:11.969470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:11.998948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8a91a94-da48-41d2-8f71-23867d9b8aee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Sep 11 05:49:11.999666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 783/1805] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:13.010955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:13.013520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:13.020250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:13.020735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:13.021177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:13.021873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:13.022325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:13.022753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:13.052812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b118d9b-27a2-48f4-bf38-887894659971 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Sep 11 05:49:13.053367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1023/1806] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:14.065913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:14.068098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:14.075141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:14.075622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:14.076081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:14.076770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:14.077217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:14.077715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:14.107267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e91aae1d-c13d-4613-91a1-f21017435078 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Sep 11 05:49:14.107835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 784/1807] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:15.119634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:15.122423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:15.128799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:15.129286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:15.129723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:15.130420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:15.130875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:15.131592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:15.160756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5c1b111-62f2-4400-9500-24436173d618 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Sep 11 05:49:15.161314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1024/1808] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:16.173620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:16.175812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:16.182928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:16.183411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:16.183850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:16.184578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:16.185033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:16.185456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:16.215604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60811900-ab02-4574-835b-a13afa04ca13 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Sep 11 05:49:16.216193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 785/1809] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:17.228216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:17.230315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:17.236883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:17.237371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:17.237811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:17.238504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:17.238957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:17.239385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:17.269717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bdf1220-baa9-4f89-beec-61713bee6da3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Sep 11 05:49:17.270271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1025/1810] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:18.282339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:18.284480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:18.291296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:18.291771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:18.292232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:18.292914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:18.293364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:18.293783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:18.323758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fdbf50f8-10b8-410d-841e-7d70cdb8d080 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Sep 11 05:49:18.324365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 786/1811] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:19.336089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:19.338404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:19.344972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:19.345463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:19.345905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:19.346598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:19.347057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:19.347492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:19.378051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76e06d32-3176-408f-9ed5-a643ef8831b4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Sep 11 05:49:19.378617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1026/1812] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:20.390552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:20.392696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:20.399976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:20.400596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:20.401123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:20.401955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:20.402410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:20.402831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:20.432356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17456a07-7aa6-41a0-86c9-1726340d3c97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Sep 11 05:49:20.432931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 787/1813] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:21.444808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:21.447349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:21.454525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:21.455034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:21.455474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:21.456206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:21.456665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:21.457095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:21.487943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-172367a9-e876-4c7b-830b-9f74f7271f00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046969 Sep 11 05:49:21.488536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1027/1814] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:22.500631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:22.502764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:22.509851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:22.510332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:22.510768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:22.511454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:22.511908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:22.512380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:22.541763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1bdd047b-c016-4766-9ff5-135dac08c4d1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Sep 11 05:49:22.542319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 788/1815] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:23.554010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:23.557119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:23.563438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:23.563913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:23.564373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:23.565050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:23.565495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:23.565912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:23.595409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e887d82f-ea79-4099-9864-ead59b46e725 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Sep 11 05:49:23.595942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1028/1816] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:24.606795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:24.608980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:24.615320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:24.615796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:24.616270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:24.617485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:24.617954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:24.618376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:24.647471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eae7b06d-834c-4124-a7cb-e2eb4f7a8f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Sep 11 05:49:24.648041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 789/1817] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:49:25.659894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:25.662097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:25.668445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:25.668931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:25.669377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:25.670067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:25.670522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:25.670949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:25.700191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3d97a9c-6826-436a-a9fd-374bdfa7551c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Sep 11 05:49:25.700738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1029/1818] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:26.711716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:26.714449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:26.720770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:26.721254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:26.721695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:26.722391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:26.722851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:26.723280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:26.753729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d1ee7da-f819-4ad7-adcb-0c6f76ceac7e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Sep 11 05:49:26.754295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 790/1819] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:27.766431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:27.768723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:27.775529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:27.776123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:27.776636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:27.777393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:27.777921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:27.778433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:27.795507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:27.810219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82a1e392-103d-43b7-9ebe-4f94536333a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Sep 11 05:49:27.810778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1030/1820] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:28.823505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:28.825727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:28.832194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:28.832687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:28.833131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:28.833833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:28.834292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:28.834721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:28.864744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56c039b7-7913-413d-ae5d-4cfc391d1ab8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Sep 11 05:49:28.865293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 791/1821] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:29.877275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:29.879469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:29.881510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=34 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:29.886946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:29.887453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:29.887898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:29.888629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:29.889092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:29.889780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:29.919804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97a15e53-e32d-4593-8ad9-18d8aca87bb2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 11 05:49:29.920383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1031/1822] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:30.933108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:30.935280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:30.937693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=36 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:30.942870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:30.943356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:30.943794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:30.944531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:30.945020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:30.945412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:30.976030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a057d585-6d1f-4c55-8033-3e7186bfd48e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Sep 11 05:49:30.976750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 792/1823] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:31.988341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:31.990492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:31.997042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:31.997528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:31.997965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:31.998656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:31.999111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:31.999537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:32.030624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47064c1c-d359-4e85-94d0-3376d9f4af61 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Sep 11 05:49:32.031214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1032/1824] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:33.042802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:33.045084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:33.051304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:33.051787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:33.052257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:33.052959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:33.053415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:33.053865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:33.056549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=99 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:33.086290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a85bb81b-4ee3-401e-b877-373cbe8b5fb7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Sep 11 05:49:33.086849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 793/1825] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:34.099766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:34.101970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:34.109100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:34.109585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:34.110029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:34.110753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:34.111205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:34.111636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:34.141716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-624fe981-61c0-4900-9874-aa6281b28d35 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Sep 11 05:49:34.142261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1033/1826] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:35.154446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:35.156638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:35.162988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:35.163472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:35.163915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:35.164641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:35.165701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:35.166130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:35.195136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-388a426d-2b64-4f43-a573-274678aa2289 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Sep 11 05:49:35.195842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 794/1827] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:36.207315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:36.209643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:36.217190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:36.217684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:36.218290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:36.218937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:36.219526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:36.219972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:36.251237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27361d31-ebc5-4ac1-a3e3-59852bdecce6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047501 Sep 11 05:49:36.251697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1034/1828] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:37.263236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:37.265688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:37.272466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:37.272955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:37.273394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:37.274095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:37.274550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:37.274980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:37.304429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05ebddeb-21bc-4e3c-bcd5-913eb7e96956 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Sep 11 05:49:37.304998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 795/1829] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:38.317450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:38.319616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:38.326734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:38.327214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:38.327657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:38.328398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:38.328854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:38.329344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:38.359886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea7a45e1-6ba5-4bc2-87c4-6b371bc2a560 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Sep 11 05:49:38.360478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1035/1830] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:39.372770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:39.374892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:39.381222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:39.381693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:39.382132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:39.382814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:39.383262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:39.383680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:39.414473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9b2d9e1-2d7c-4b5a-828d-bda8ec3fdf01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Sep 11 05:49:39.420155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 796/1831] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:40.427946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:40.430034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:40.437234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:40.437722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:40.438159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:40.438894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:40.439328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:40.439752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:40.469582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-998bb3fd-26c5-4da9-82f1-c0e8cb9542f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Sep 11 05:49:40.470143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1036/1832] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:41.482147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:41.484362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:41.490853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:41.491401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:41.491839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:41.492583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:41.493031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:41.493448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:41.524097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-785dba72-0fe0-4bba-878c-5fa379ab63df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Sep 11 05:49:41.524654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 797/1833] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:42.537519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:42.539913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:42.547239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:42.547728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:42.548197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:42.548882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:42.549488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:42.550053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:42.585373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a198970c-e64f-4bc8-9361-e15a48c54cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052305 Sep 11 05:49:42.585962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1037/1834] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:43.598808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:43.601003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:43.607851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:43.608434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:43.608877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:43.609572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:43.610028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:43.610454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:43.640383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4722d2bc-b256-48f0-a422-6e4dc0852b36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Sep 11 05:49:43.640859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 798/1835] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:44.652769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:44.655161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:44.661563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:44.662039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:44.662470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:44.663146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:44.663624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:44.664072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:44.693512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae5135e6-88f5-4730-8630-6872f5027c0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Sep 11 05:49:44.694048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1038/1836] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:45.705944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:45.708089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:45.714462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:45.714934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:45.715367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:45.716974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:45.717428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:45.717853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:45.746269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0480f10d-5685-4680-8862-0386db586e77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Sep 11 05:49:45.746898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 799/1837] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:46.758982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:46.761258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:46.768345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:46.768825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:46.769259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:46.769947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:46.770393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:46.770813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:46.801839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f21b5ca3-59d3-41c7-ad60-f2aee6cc068c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Sep 11 05:49:46.802400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1039/1838] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:47.814805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:47.817036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:47.823318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:47.823799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:47.824271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:47.825685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:47.826220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:47.826649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:47.854960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd0d47ef-8cfb-40a8-b0d5-bce5b36466e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Sep 11 05:49:47.855513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 800/1839] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:48.867770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:48.869938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:48.876729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:48.877210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:48.877641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:48.878322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:48.878771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:48.879195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:48.909570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c759305f-a099-420b-aa71-c191bda33e82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Sep 11 05:49:48.910115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1040/1840] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:49.922607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:49.924819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:49.931228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:49.931699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:49.932181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:49.932883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:49.933343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:49.933782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:49.962507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8685ecc0-80ff-499e-bf4a-ef510aadc7b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Sep 11 05:49:49.963067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 801/1841] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:50.974855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:50.977024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:50.984442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:50.984922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:50.985357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:50.986042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:50.986492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:50.986911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:51.016360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cce897d9-0965-48d2-b978-f7b3ed101941 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Sep 11 05:49:51.016895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1041/1842] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:52.028077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:52.030312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:52.036594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:52.037077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:52.037512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:52.038203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:52.038658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:52.039086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:52.068687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eae2fe01-73b5-4bff-96f5-888c9edf8612 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Sep 11 05:49:52.069242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 802/1843] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:53.081186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:53.083320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:53.089655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:53.090140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:53.091241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:53.092075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:53.092528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:53.092951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:53.121996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d8cfdd3-ab16-4d45-b8d3-d95f1790a728 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Sep 11 05:49:53.122658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1042/1844] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:54.134499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:54.136685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:54.140207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:49:54.140347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:49:54.145800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:54.146284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:54.146724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:54.147419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:54.147878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:54.148343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:54.178973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4481ba9b-1c97-45db-8b4a-6bb2b9fc4cc9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048402 Sep 11 05:49:54.179534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 803/1845] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:55.191205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:55.193396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:55.199741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:55.200517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:55.200955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:55.201641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:55.202093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:55.202517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:55.234686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7235ba3b-ef8e-40b3-a3ab-0c41a2c5b139 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047413 Sep 11 05:49:55.235223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1043/1846] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:56.247567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:56.249818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:56.256266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:56.256751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:56.257195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:56.257888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:56.258346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:56.258774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:56.287535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4402b46-66c2-4d3c-ba67-a4736c78ea83 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Sep 11 05:49:56.288107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 804/1847] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:57.299907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:57.302098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:57.308534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:57.309494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:57.310018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:57.310629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:57.311086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:57.311514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:57.340765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-329a6fb8-8f41-4888-98e4-7e6c2e3c4d74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Sep 11 05:49:57.341314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1044/1848] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:49:58.353112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:58.355265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:58.358626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:49:58.358773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:49:58.365595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:58.366079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:58.366517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:58.367216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:58.367670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:58.368164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:58.399010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9f3a929-89e7-4041-a80a-6b58e5334d34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049818 Sep 11 05:49:58.399570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 805/1849] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:49:59.412484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:49:59.414652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:49:59.422098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:59.422577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:59.423011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:59.423690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:49:59.424190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:49:59.424613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:49:59.428114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=87 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:49:59.454709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-352b116a-c8e0-49d2-aa23-e3aeca2e55c1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Sep 11 05:49:59.455245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1045/1850] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:49:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:00.469795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:00.472194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:00.478439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:00.478920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:00.479357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:00.480081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:00.480538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:00.481552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:00.509772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-081407a8-9325-4075-ac49-bacf335ffdf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046730 Sep 11 05:50:00.510324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 806/1851] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:50:01.522167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:01.524426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:01.526702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=30 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:01.532249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:01.532757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:01.533191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:01.533870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:01.534320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:01.534739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:01.564884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be1999ad-82d1-410f-9fcd-8bfab4764cd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Sep 11 05:50:01.565823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1046/1852] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:02.580633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:02.582817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:02.585092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=30 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:02.590220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:02.590818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:02.591259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:02.591951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:02.592432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:02.592857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:02.622134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae04f238-1783-4c95-afe1-bb9c88e2db19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Sep 11 05:50:02.622866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 807/1853] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:03.634644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:03.637370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:03.644244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:03.644836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:03.645272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:03.645958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:03.646405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:03.646827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:03.676552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3831e95-4f4d-45b6-a0de-0ff8135a1b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Sep 11 05:50:03.677098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1047/1854] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:04.688930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:04.691044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:04.697527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:04.698007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:04.698441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:04.699150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:04.699817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:04.700331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:04.702644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=90 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:04.730265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e419290-249d-4b4e-b80b-ca52ff54a687 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Sep 11 05:50:04.731847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 808/1855] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:05.743811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:05.745969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:05.753077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:05.753561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:05.754074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:05.754781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:05.755236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:05.755664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:05.786185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ba98011-afbd-4f06-a954-051a02203e74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Sep 11 05:50:05.786724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1048/1856] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:06.798919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:06.801084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:06.807658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:06.808189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:06.808697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:06.809409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:06.809867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:06.810312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:06.839381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e21d0d51-95a7-49ce-a064-4ccb914f0d2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Sep 11 05:50:06.840588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 809/1857] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:07.852596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:07.854770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:07.862149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:07.862640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:07.863078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:07.863777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:07.864272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:07.864704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:07.893928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7fb82d2-c295-486f-8be6-c21606e1a032 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Sep 11 05:50:07.894475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1049/1858] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:08.906534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:08.908660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:08.915018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:08.915503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:08.915945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:08.916678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:08.917137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:08.917567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:08.948798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae5d9269-9205-42b9-8085-01ca048c04f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Sep 11 05:50:08.949379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 810/1859] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:09.961431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:09.963484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:09.970974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:09.971456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:09.971890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:09.972600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:09.973051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:09.973473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:10.002965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d89b938-d449-4aaa-82dd-25a736e14dad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Sep 11 05:50:10.003509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1050/1860] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:11.015179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:11.017339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:11.023781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:11.024357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:11.024795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:11.025483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:11.025935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:11.026469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:11.059612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a03b87d-5d4b-4b51-b0b3-5f1d7f7de428 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048737 Sep 11 05:50:11.060208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 811/1861] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:12.071463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:12.073679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:12.080037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:12.080519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:12.080951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:12.081631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:12.082077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:12.082497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:12.112039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3bd6154-98e1-4f08-a269-9a513e74e417 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Sep 11 05:50:12.112584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1051/1862] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:13.124350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:13.126495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:13.132852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:13.133333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:13.133771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:13.134512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:13.134920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:13.135345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:13.165871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03473934-e74d-4784-8aea-4c81cfad5d16 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Sep 11 05:50:13.166418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 812/1863] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:14.178391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:14.180637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:14.187144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:14.187626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:14.188095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:14.188795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:14.189252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:14.189682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:14.219629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7987b228-9cd0-4813-b5d5-68a4c7d8453a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Sep 11 05:50:14.220126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1052/1864] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:15.231972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:15.234096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:15.240474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:15.240953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:15.241389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:15.242078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:15.242533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:15.242957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:15.271988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20947b61-797a-473e-8e39-cc3c3292766f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Sep 11 05:50:15.272557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 813/1865] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:16.284702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:16.286908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:16.294328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:16.294812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:16.295248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:16.295936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:16.296426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:16.296853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:16.325327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e441b03b-9942-4b38-b48c-63b8a84fd854 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 11 05:50:16.325874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1053/1866] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:17.337584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:17.339718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:17.346104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:17.346585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:17.347025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:17.347719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:17.348208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:17.348636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:17.378112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bc15e95-07e9-4f9d-8ccc-57b9b4930543 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Sep 11 05:50:17.378592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 814/1867] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:18.391421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:18.393580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:18.396028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:50:18.396191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:50:18.402499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:18.403163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:18.403603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:18.404374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:18.404822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:18.405296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:18.436693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-723c0c6e-dc7d-4c14-bc3a-3da032293bdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050254 Sep 11 05:50:18.437164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1054/1868] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:19.449743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:19.451879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:19.458194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:19.458681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:19.459119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:19.459843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:19.460328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:19.460755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:19.489901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1702452f-6d4a-4f4d-aba0-468e19599367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Sep 11 05:50:19.490384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 815/1869] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:20.502890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:20.505123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:20.511725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:20.512888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:20.513336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:20.514029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:20.514490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:20.515184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:20.543718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-103dd6d2-f81c-4184-bf3c-a50d06978f05 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Sep 11 05:50:20.544305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1055/1870] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:21.555880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:21.558204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:21.564847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:21.565339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:21.565781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:21.566480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:21.566938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:21.567368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:21.597724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff900f48-fd63-4508-8b85-ad571c7a6e62 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Sep 11 05:50:21.598212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 816/1871] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:22.610723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:22.612924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:22.619257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:22.619739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:22.620222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:22.620942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:22.622040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:22.622449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:22.651112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2eb24bd3-6bb6-42b1-98c5-c4795f63b73c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Sep 11 05:50:22.651653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1056/1872] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:23.663584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:23.665666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:23.672207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:23.672689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:23.673126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:23.673813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:23.674268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:23.674881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:23.708870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b850666-a701-452c-8692-42a4595481c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049249 Sep 11 05:50:23.709429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 817/1873] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:24.722275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:24.724384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:24.730746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:24.731231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:24.731664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:24.732385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:24.732843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:24.733270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:24.762544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d868c129-a6f0-46e5-af40-e13f6b8f86d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Sep 11 05:50:24.763090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1057/1874] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:25.775270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:25.777400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:25.783750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:25.784273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:25.784716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:25.785413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:25.785870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:25.786394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:25.816934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c4e17af-f066-42e9-9b68-4b4d50d73f31 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Sep 11 05:50:25.817503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 818/1875] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:26.829542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:26.831666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:26.837678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:26.838179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:26.838607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:26.839303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:26.839764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:26.840305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:26.869247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-983e06d2-ec6d-4e18-b6ab-38e83e719aa2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Sep 11 05:50:26.869803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1058/1876] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:27.882389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:27.884498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:27.891227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:27.891709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:27.892183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:27.892887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:27.893346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:27.893775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:27.923036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e3ec781-c890-439a-a3dd-1fbb13b2b7dc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 11 05:50:27.923595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 819/1877] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:28.935903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:28.938110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:28.944070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:28.944561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:28.945994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:28.945994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:28.946218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:28.946539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:28.975849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3778818c-9cf4-412a-8341-18db4d2cf002 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 11 05:50:28.978200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1059/1878] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:29.989369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:29.990567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:29.997688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:29.998186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:29.998648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:29.999342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:29.999793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:30.000250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:30.036307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e90017f9-aa6d-474c-b890-600756ef8d97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051824 Sep 11 05:50:30.036894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 820/1879] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:31.049018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:31.051135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:31.057568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:31.058054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:31.059155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:31.059860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:31.060343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:31.060774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:31.063106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=90 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:31.090878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf8caef6-21af-4fbd-b590-dbf5fa882f0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Sep 11 05:50:31.091418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1060/1880] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:32.102812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:32.104975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:32.112016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:32.112503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:32.112938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:32.113623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:32.114092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:32.114504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:32.143521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3704ea0e-91b2-4b8c-84f5-8b4ea8a5e384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Sep 11 05:50:32.144094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 821/1881] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:33.156233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:33.158960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:33.161384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=30 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:33.166614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:33.167094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:33.167530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:33.168443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:33.169276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:33.169742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:33.200389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a92a7180-e643-4df6-a02d-5198912427ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Sep 11 05:50:33.201053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1061/1882] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:34.212776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:34.215495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:34.217873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=30 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:34.222895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:34.223431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:34.223873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:34.224593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:34.225043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:34.225469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:34.254638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a8ee537-4864-496c-b6f0-4b2197f52a17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Sep 11 05:50:34.255182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 822/1883] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:35.267275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:35.269466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:35.275788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:35.276296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:35.276729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:35.277415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:35.277868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:35.278285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:35.308060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80ef6ffe-2d5b-4ebe-9e12-e36cdd8c2b0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Sep 11 05:50:35.309161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1062/1884] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:36.321001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:36.323113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:36.330518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:36.330995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:36.331428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:36.332161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:36.332615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:36.333034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:36.336539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=90 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:36.363889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5250c8fc-53a2-417e-b0f9-3736f9188647 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Sep 11 05:50:36.364474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 823/1885] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:37.376961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:37.379108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:37.385445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:37.385931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:37.386371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:37.387058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:37.387514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:37.388061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:37.416659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13bc4260-a24e-4499-878a-e0844bd80987 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Sep 11 05:50:37.417191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1063/1886] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:38.429707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:38.431739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:38.438557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:38.439035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:38.439475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:38.440189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:38.440641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:38.441061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:38.470566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-979ab554-7db8-4d0f-b167-31ec68452d68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 11 05:50:38.471119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 824/1887] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:39.483586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:39.485771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:39.492223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:39.492713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:39.493161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:39.493884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:39.494346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:39.494777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:39.523918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3050817e-5049-45db-880a-73a047bd8898 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Sep 11 05:50:39.524491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1064/1888] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:40.537430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:40.539595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:40.546371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:40.546846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:40.547280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:40.547962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:40.548437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:40.548856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:40.578314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01bb11c7-d241-4125-a7ee-a604abb24d65 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Sep 11 05:50:40.578869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 825/1889] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:41.591176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:41.593545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:41.600138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:41.600564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:41.600996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:41.601672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:41.602121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:41.602541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:41.632512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30108af6-f401-463f-8315-c9d4ce845376 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 11 05:50:41.633051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1065/1890] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:42.645500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:42.647626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:42.654108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:42.654585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:42.655023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:42.655718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:42.656205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:42.656634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:42.688030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58aafc29-1e42-4972-8960-0ae87ff0ceda tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Sep 11 05:50:42.688591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 826/1891] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:43.701271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:43.703376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:43.709718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:43.710193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:43.710625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:43.711306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:43.711754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:43.712209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:43.741198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a53bbe99-f5df-4de7-b604-475e7b0c10db tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Sep 11 05:50:43.741737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1066/1892] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:44.753530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:44.755677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:44.761964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:44.762518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:44.763105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:44.763796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:44.764277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:44.764709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:44.795143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb89aebf-736f-47ea-beca-dfa4c1d0fb30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Sep 11 05:50:44.796141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 827/1893] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:45.732456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:45.733023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:45.739279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.739782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.740244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:45.740927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.741379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.741801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:45.767192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:50:45.806579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:45.810473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:45.817195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.817688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.818129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:45.818837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.819288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.819715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:45.852455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76e43e4f-0a2e-4178-8583-7d02e86d8e0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 204 len: 0 microversion: 2.20 time: 0.122592 Sep 11 05:50:45.853296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1067/1894] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 11 05:50:45 2022] DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 05:50:45.854673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b69fd6dc-4e04-442a-a62e-8cab78b6c4f5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051699 Sep 11 05:50:45.855616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 828/1895] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:50:45.866840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:45.867547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:45.874107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.874585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.875022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:45.875709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:45.876201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:45.876631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:46.006490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:46.015618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:46.017087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:46.018316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3aa2013-3c20-4202-b5ee-ba6415a1ad23 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155740 Sep 11 05:50:46.018870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1068/1896] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:50:46.868258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:46.870429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:46.877486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:46.877972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:46.878421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:46.879117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:46.879578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:46.880023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:46.909247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f258eed4-b883-4293-a3d7-4a48713d55e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 11 05:50:46.909802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 829/1897] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:47.044478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:47.045087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:47.051477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:47.051959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:47.052437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:47.053131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:47.053587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:47.054014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:47.182731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:47.191953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:47.193447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:47.194607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af68bf3b-c092-4f71-ac84-c87be671486e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154721 Sep 11 05:50:47.195162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1069/1898] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:47.922194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:47.924394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:47.930653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:47.931127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:47.931561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:47.932267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:47.932966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:47.933152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:47.962466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99027302-7ca2-4fdb-89a2-5ecdfc03780f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 11 05:50:47.962946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 830/1899] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:48.220114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:48.220682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:48.227049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:48.227532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:48.228011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:48.228730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:48.229186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:48.229615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:48.363813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:48.372637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:48.374069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:48.375229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99bddaae-5feb-488b-9a58-a84c58562d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159172 Sep 11 05:50:48.376028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1070/1900] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:48.975211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:48.977452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:48.984160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:48.984648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:48.985093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:48.985792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:48.986252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:48.986681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:49.016623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cfe17e3e-4243-4c59-8df0-049b12aea2cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Sep 11 05:50:49.017106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 831/1901] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:49.401598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:49.402221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:49.408877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:49.409368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:49.409810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:49.410508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:49.410967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:49.411393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:49.538971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:49.548931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:49.550391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:49.551636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-425a7412-9577-45d6-9e9f-3ec6ee83d104 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154179 Sep 11 05:50:49.552299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1071/1902] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:50.030099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:50.032261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:50.038531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:50.039011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:50.039448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:50.040211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:50.040668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:50.041094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:50.070338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f7bf1e8-1f42-42fc-b4cf-148a583598aa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Sep 11 05:50:50.070899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 832/1903] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:50.577950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:50.578601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:50.585009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:50.585492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:50.585957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:50.586651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:50.587109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:50.587536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:50.725702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:50.734372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:50.735838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:50.737067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7986c36-0a83-4ee5-a5db-3ed82961e26f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163839 Sep 11 05:50:50.737625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1072/1904] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:50:51.083291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:51.085483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:51.092026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:51.092529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:51.092976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:51.093675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:51.094134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:51.094560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:51.123843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b65b345-171f-4981-8d5a-aadeda8dbd3c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Sep 11 05:50:51.124419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 833/1905] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:51.762435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:51.763336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:51.770030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:51.770502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:51.770929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:51.771607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:51.772083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:51.772507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:51.899752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:51.909514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:51.911055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:51.912628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e20ab2f6-def8-4983-a47c-489179cc275d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154246 Sep 11 05:50:51.913216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1073/1906] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:52.135624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:52.138523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:52.145122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:52.145601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:52.146043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:52.146735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:52.147191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:52.147616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:52.176192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d9d7ae2-5552-4696-8e82-b71a01806ac5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Sep 11 05:50:52.176738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 834/1907] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:52.938783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:52.939489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:52.946100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:52.946588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:52.947030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:52.947721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:52.948210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:52.948640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:53.079906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:53.088552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:53.090657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:53.091887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-931f1955-eb1b-4e52-b9ba-2248f391535d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157065 Sep 11 05:50:53.092477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1074/1908] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:53.188462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:53.190618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:53.197006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:53.197497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:53.197936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:53.198635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:53.199094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:53.200059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:53.229911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a92dd974-7256-4ea5-b5df-c3b29ff2e54e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Sep 11 05:50:53.230469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 835/1909] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:54.117385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:54.117929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:54.124759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:54.125238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:54.125667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:54.126353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:54.126803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:54.127223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:54.129849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:54.242522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:54.244708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:54.251551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:54.252061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:54.252506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:54.253218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:54.253676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:54.254102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:54.255799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:54.265455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:54.266915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:54.268109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1482e73-8c91-40d4-9717-63a1281c3702 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154628 Sep 11 05:50:54.268671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1075/1910] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:54.284345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88e956e2-cde7-4f91-acd7-9d570335cf34 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Sep 11 05:50:54.284902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 836/1911] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:50:55.292038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:55.292588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:55.297207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:55.299401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:55.299735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:55.300269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:55.300712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:55.301411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:55.301866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:55.302292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:55.305673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:55.306161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:55.306603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:55.307305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:55.307766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:55.308222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:55.337871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d56e06d9-98cc-42c9-8ea0-d5cde46991b5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Sep 11 05:50:55.338435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 837/1912] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:50:55.432158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:55.440797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:55.442262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:55.443418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73e5dd52-646b-4248-b563-f091be20b6d1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155358 Sep 11 05:50:55.443974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1076/1913] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:56.350642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:56.352861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:56.359784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:56.360317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:56.360753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:56.361437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:56.361886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:56.362304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:56.391984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5dfb5730-d017-4fe1-8eec-c31c41c4102f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Sep 11 05:50:56.392534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 838/1914] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:56.470377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:56.470983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:56.477998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:56.478479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:56.478909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:56.479598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:56.480116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:56.481231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:56.650366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:56.659598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:56.661053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:56.662217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fccc608-b2e3-4e6b-8a6f-1b6edf965899 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.197442 Sep 11 05:50:56.662953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1077/1915] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:57.404452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:57.406582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:57.413025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:57.413511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:57.413947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:57.414634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:57.415083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:57.415506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:57.440764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:50:57.445727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82b41f85-933a-44f1-9eef-92977578256d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Sep 11 05:50:57.446278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 839/1916] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:57.689490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:57.690101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:57.696464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:57.696943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:57.697373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:57.698058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:57.698530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:57.698955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:57.826117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:57.834746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:57.836195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:57.837352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-076dd2e7-e0c3-426b-8cec-85ed7fcfd261 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151969 Sep 11 05:50:57.837902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1078/1917] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:58.459553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:58.461867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:58.469849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:58.470329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:58.470821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:58.471568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:58.472131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:58.472556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:58.501741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9496cf96-8c96-487c-954c-2dbb16d9302f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 Sep 11 05:50:58.502294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 840/1918] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:50:58.862586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:58.863198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:58.869097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:58.869572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:58.870006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:58.870684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:58.871655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:58.872099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:59.004798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:59.014046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:59.015735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:50:59.016954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8edfd30c-c874-40a5-9fbf-147d58eeb1f4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158412 Sep 11 05:50:59.017538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1079/1919] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:50:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:50:59.513333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:50:59.515741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:50:59.522287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:59.522768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:59.523208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:59.523903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:50:59.524386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:50:59.524814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:50:59.554821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96ece05d-d191-42ea-86fe-f4ab7db5d8cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 11 05:50:59.555369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 841/1920] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:50:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:00.041792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:00.042425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:00.048957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:00.049441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:00.049881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:00.050570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:00.051041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:00.051442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:00.177172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:00.186837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:00.188341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:00.189516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-040b5e17-cd71-4a70-95d2-33039e879b0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151581 Sep 11 05:51:00.190063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1080/1921] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:00.567650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:00.569862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:00.575976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:00.576491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:00.576933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:00.577634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:00.578094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:00.578526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:00.608346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d6c6040-3e85-4933-8f58-4bc24ebe7f4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Sep 11 05:51:00.608902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 842/1922] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:01.214880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:01.215690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:01.222006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:01.222493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:01.222935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:01.223629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:01.224111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:01.224543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:01.357493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:01.366058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:01.367493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:01.368680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2146e98-cb8c-4c2d-9ad8-c9cc458fec40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157733 Sep 11 05:51:01.369237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1081/1923] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:01.620732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:01.623480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:01.629734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:01.630209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:01.630636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:01.631317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:01.631763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:01.632212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:01.661511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00a08c7f-fec6-4980-b7dc-be04ce75eb47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Sep 11 05:51:01.662064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 843/1924] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:02.394969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:02.395598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:02.402051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:02.403204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:02.403766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:02.404485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:02.404947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:02.405377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:02.534882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:02.543614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:02.545089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:02.546250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-118490c9-3346-452b-bd39-00adf43f1efa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155247 Sep 11 05:51:02.546796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1082/1925] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:02.673859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:02.675987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:02.682294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:02.682852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:02.683293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:02.684636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:02.685096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:02.685523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:02.714921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a41ba51a-0c04-48e6-8a5d-b64fc06eb96f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Sep 11 05:51:02.715479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 844/1926] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:03.571953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:03.572590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:03.575690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:03.581483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:03.581830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:03.582271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:03.582959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:03.583412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:03.583834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:03.717488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:03.726103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:03.726671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:03.727557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:03.728783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9432a1fe-ce1a-4949-b5e6-fd1ee07efdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160734 Sep 11 05:51:03.728942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:03.729484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1083/1927] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:03.735553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:03.736062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:03.736498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:03.737196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:03.737654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:03.738076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:03.768242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e0f54ae-1397-41dd-93f1-f5955d3ceef5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Sep 11 05:51:03.768834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 845/1928] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:04.753794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:04.754348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:04.760906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:04.761394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:04.761981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:04.762971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:04.763424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:04.763852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:04.781217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:04.783628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:04.787069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=48 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:04.791187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:04.791674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:04.792168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:04.793536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:04.793996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:04.794424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:04.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-259ed18b-ae55-410a-af8c-0e89b6133b2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Sep 11 05:51:04.826044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 846/1929] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:04.896677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:04.905841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:04.907309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:04.908515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8b404e9-7790-483e-8cfe-60e2cf392b7d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158823 Sep 11 05:51:04.909074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1084/1930] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:05.837644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:05.839832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:05.846222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:05.846707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:05.847145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:05.847839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:05.848345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:05.848776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:05.879616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d650e2dc-2257-4b8c-b3f5-7ba9f043e034 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Sep 11 05:51:05.880220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 847/1931] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:05.934852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:05.935387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:05.941841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:05.942332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:05.942776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:05.943471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:05.943932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:05.944392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:06.072410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:06.081189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:06.082625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:06.083810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59da57a5-f2bd-41d9-9b13-5c2b9cf779d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153557 Sep 11 05:51:06.084590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1085/1932] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:06.896179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:06.899896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:06.910108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:06.910587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:06.911023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:06.911716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:06.912196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:06.912621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:06.942198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17475fe6-3d16-4ff5-9b3e-4022fa523a97 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052280 Sep 11 05:51:06.942730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 848/1933] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:07.110089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:07.110709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:07.117226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:07.117716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:07.118158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:07.118855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:07.119315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:07.119751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:07.251285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:07.259803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:07.261274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:07.263133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aea792ea-0b5a-4423-8941-b581d59e3306 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157444 Sep 11 05:51:07.263698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1086/1934] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:07.954675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:07.956912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:07.963212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:07.963696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:07.964172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:07.965440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:07.966057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:07.966483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:07.999732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7344c51-1c3c-46ff-87f6-2a039e0a71ca tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049067 Sep 11 05:51:08.000332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 849/1935] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:08.288399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:08.289029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:08.295410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:08.295903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:08.296383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:08.297079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:08.297538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:08.297970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:08.424600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:08.433831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:08.435340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:08.436549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d7738f9-3588-4ee2-b67c-3b9871400b26 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152032 Sep 11 05:51:08.437104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1087/1936] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:09.012858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:09.015298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:09.021634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:09.022116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:09.022558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:09.023252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:09.023709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:09.024183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:09.053783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0da3ac1-50fb-4b6b-b817-d73c18a80505 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Sep 11 05:51:09.054333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 850/1937] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:09.460926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:09.461552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:09.468340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:09.468827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:09.469265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:09.469976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:09.470431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:09.470856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:09.601618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:09.610922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:09.612495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:09.613669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-943fda69-216a-47ec-b549-ead0fdb80570 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156693 Sep 11 05:51:09.614216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1088/1938] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:10.066318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:10.068495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:10.074872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:10.075346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:10.075779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:10.076487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:10.076937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:10.077359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:10.106665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af722d99-e84d-479b-b61d-005162c8891a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Sep 11 05:51:10.107211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 851/1939] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:10.639336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:10.639951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:10.646547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:10.647040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:10.648218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:10.648927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:10.649386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:10.649817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:10.797959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:10.810433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:10.813101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:10.814511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a188c0b-2202-4238-9707-535d5e873458 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.179590 Sep 11 05:51:10.815273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1089/1940] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:11.119335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:11.122673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:11.132602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:11.133387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:11.134094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:11.135227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:11.136036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:11.136729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:11.170502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fea087e9-1b53-4a46-b189-639b229fbc30 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055540 Sep 11 05:51:11.171070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 852/1941] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:11.840926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:11.841645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:11.848385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:11.848737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:11.849171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:11.849861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:11.850315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:11.850739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:11.981416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:11.990497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:11.991940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:11.993134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-465d1b90-f030-455a-a097-d1c79e14bb36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156854 Sep 11 05:51:11.993694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1090/1942] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:12.182993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:12.185688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:12.191875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:12.192382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:12.192814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:12.193500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:12.193964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:12.194380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:12.223235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-84c5172b-7293-4da5-b1ca-03ba18c9b40c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 Sep 11 05:51:12.223787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 853/1943] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:13.022942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:13.023560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:13.030627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:13.030873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:13.031312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:13.032024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:13.032493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:13.032925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:13.166651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:13.169765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:13.177338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:13.178787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:13.179967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89c3aab5-650f-43cc-a252-4d5c3f614b75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160925 Sep 11 05:51:13.180526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1091/1944] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:13.235466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:13.237643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:13.243869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:13.244383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:13.244821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:13.246022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:13.246500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:13.246925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:13.276252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3314009-1691-4e9d-a497-b26ee7d36dc0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Sep 11 05:51:13.276838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 854/1945] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:14.205748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:14.206365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:14.212793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:14.213282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:14.213719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:14.215067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:14.215525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:14.215955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:14.288955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:14.291496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:14.297974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:14.298461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:14.298901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:14.299604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:14.300079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:14.300507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:14.330009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f131341-6e79-41a8-8812-50e44f55014f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Sep 11 05:51:14.330575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 855/1946] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:14.342847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:14.351307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:14.352767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:14.353924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e142dbb9-4244-4ba5-80f4-5fecca2530d8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152031 Sep 11 05:51:14.354481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1092/1947] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:15.342321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:15.344552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:15.350768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:15.351243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:15.351683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:15.352400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:15.352851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:15.353269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:15.366490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:15.378564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:15.379259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:15.383599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dfd2da49-1f8c-43a7-b876-791f0f2824e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Sep 11 05:51:15.384247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 856/1948] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:15.385632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:15.386158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:15.387213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:15.387909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:15.388389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:15.388817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:15.517444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:15.525840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:15.527678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:15.528910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1736c459-049b-4fa5-8dd9-ff18c8a8044a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154164 Sep 11 05:51:15.529476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1093/1949] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:51:16.396895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:16.399034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:16.405508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:16.405985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:16.406423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:16.407106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:16.407555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:16.407974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:16.437807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6b26d9f-f505-4587-96e4-11f195b70403 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Sep 11 05:51:16.438354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 857/1950] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:16.554307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:16.554914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:16.562058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:16.562541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:16.562977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:16.563667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:16.564154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:16.564575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:16.691988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:16.700623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:16.702081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:16.703231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28e2a998-0b3c-4668-a3a5-4278c6e08b67 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152872 Sep 11 05:51:16.703787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1094/1951] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:17.450756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:17.452941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:17.459296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:17.459770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:17.460239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:17.460931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:17.461385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:17.461806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:17.491460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5391c379-18b7-426f-8294-15b41927c6d3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Sep 11 05:51:17.492035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 858/1952] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:17.728926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:17.729482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:17.736287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:17.736764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:17.737195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:17.737871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:17.738319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:17.738800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:17.873870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:17.882318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:17.883748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:17.884923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05c5b398-ca7b-4917-81f9-07ee3c27ba81 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159993 Sep 11 05:51:17.885476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1095/1953] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:18.503755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:18.505939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:18.512835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:18.513317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:18.513751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:18.514465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:18.514899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:18.515599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:18.546992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0561b53e-606c-4a46-b061-b8e59752e059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Sep 11 05:51:18.547550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 859/1954] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:18.910573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:18.911185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:18.918297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:18.918772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:18.919203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:18.919880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:18.920359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:18.920781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:19.059925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:19.068720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:19.070151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:19.071326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63cf7ec6-b827-4b08-8fa7-24c258d7313b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.164659 Sep 11 05:51:19.071880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1096/1955] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:19.559324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:19.561484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:19.567869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:19.568388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:19.568831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:19.569527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:19.569983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:19.570413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:19.600261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c5bef34-5a36-449c-b520-a38c0333847c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Sep 11 05:51:19.600810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 860/1956] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:20.098049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:20.098663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:20.105596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:20.106085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:20.106524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:20.107210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:20.107664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:20.108117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:20.236871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:20.245330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:20.247381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:20.248586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f9c64ec-a497-402d-aba7-c4317677556f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154462 Sep 11 05:51:20.249136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1097/1957] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:20.612725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:20.614878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:20.621492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:20.622028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:20.622524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:20.623240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:20.623703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:20.624156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:20.653291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3fdd7db-1647-428f-a71f-2b5c1a9a19ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Sep 11 05:51:20.653833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 861/1958] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:21.273921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:21.274540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:21.280872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:21.281358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:21.281796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:21.282490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:21.282948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:21.283375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:21.418045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:21.426572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:21.428049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:21.429316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8603021-28d1-40f7-b3be-9ebed661f53c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159122 Sep 11 05:51:21.429815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1098/1959] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:21.665736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:21.667851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:21.674152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:21.674631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:21.675068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:21.675750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:21.676236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:21.676657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:21.705448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-918d8cfc-3ca0-409d-9963-8bfb9a6bc27f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Sep 11 05:51:21.705956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 862/1960] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:22.455131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:22.455751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:22.462257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:22.462759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:22.463179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:22.463872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:22.464977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:22.465408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:22.592625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:22.601228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:22.602674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:22.603868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2ecc577-cd2f-49ce-b25b-f35b3d05d828 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152645 Sep 11 05:51:22.604465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1099/1961] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:22.717838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:22.719957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:22.726264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:22.726737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:22.727171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:22.727854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:22.728333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:22.728754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:22.757413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5b4bd4e-48ec-45f0-8dda-d2f064a14b54 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Sep 11 05:51:22.757953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 863/1962] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:23.628820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:23.629436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:23.635950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:23.636465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:23.636896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:23.637585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:23.638040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:23.638468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:23.769654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:23.770997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:23.773208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:23.779276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:23.780458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:23.780902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:23.781036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:23.781357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:23.782047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:23.782359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-248cb22d-bdc5-4550-ac61-487f985f9144 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157384 Sep 11 05:51:23.782477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:23.782899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:23.783562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1100/1963] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:23.813612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca37cd9f-d181-4124-941d-3888e0a8e7ce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 11 05:51:23.814168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 864/1964] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:24.808838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:24.809464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:24.815952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:24.816472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:24.816911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:24.817607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:24.818067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:24.818498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:24.826425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:24.828810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:24.834859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:24.835339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:24.835773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:24.836494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:24.836943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:24.837366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:24.867922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad56b1de-5964-4b9c-a5a4-fa488ffe6da0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Sep 11 05:51:24.868702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 865/1965] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:24.945367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:24.953994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:24.955461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:24.956654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-480c2780-7fcc-4495-82b6-5095652186b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152538 Sep 11 05:51:24.957211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1101/1966] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:25.880653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:25.882802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:25.889207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:25.889691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:25.890395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:25.891088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:25.891543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:25.891967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:25.922256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c31a8d0f-aa9d-4d38-84e9-0609a31fa5fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Sep 11 05:51:25.922814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 866/1967] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:25.983068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:25.983686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:25.990068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:25.990555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:25.990993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:25.991681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:25.992168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:25.992597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:26.120821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:26.129352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:26.130804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:26.131977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-011e62bd-3a5c-4ef6-bc83-076190b0a394 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153640 Sep 11 05:51:26.132532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1102/1968] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:26.935652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:26.937830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:26.944079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:26.944554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:26.944987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:26.945666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:26.946117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:26.946537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:26.975753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6bfe43e8-61c6-4cb3-9226-45ccd73e8a41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Sep 11 05:51:26.976354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 867/1969] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:27.157661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:27.158272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:27.164616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:27.165105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:27.165543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:27.166231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:27.166688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:27.167630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:27.299831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:27.308457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:27.309915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:27.311084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99297456-1058-4fe5-8738-dd60fa6405af tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157296 Sep 11 05:51:27.311646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1103/1970] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:27.989362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:27.991551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:27.998148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:27.998635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:27.999080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:27.999778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:28.000281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:28.000700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:28.034380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-845ff04e-b877-4e4a-8da5-abe1dd273359 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049701 Sep 11 05:51:28.034935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 868/1971] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:28.335845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:28.336482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:28.343619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:28.344144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:28.344585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:28.345273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:28.345748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:28.346158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:28.471721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:28.481468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:28.483044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:28.484240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0906279-7ce0-424c-a745-a1fffe6145d2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152257 Sep 11 05:51:28.484801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1104/1972] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:29.047555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:29.049723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:29.056019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:29.056511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:29.056948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:29.058034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:29.058524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:29.058950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:29.088407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ef379ed-47df-4893-b3b3-2a3a2e1c8a01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 11 05:51:29.089741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 869/1973] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:29.510557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:29.511963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:29.518377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:29.518859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:29.519297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:29.519988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:29.520466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:29.520893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:29.651001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:29.659806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:29.661291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:29.662462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b94f0651-e895-4b2b-be1e-b7f550e525e8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155900 Sep 11 05:51:29.663012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1105/1974] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:30.101448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:30.103618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:30.109693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:30.110175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:30.110639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:30.111329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:30.111784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:30.112239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:30.142160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d1c5b265-2218-4983-af9e-fa960987ce77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Sep 11 05:51:30.142722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 870/1975] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:30.687434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:30.688075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:30.694484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:30.694964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:30.695396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:30.696099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:30.696553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:30.696968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:30.842168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:30.850841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:30.852474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:30.853638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2c0aa0a-a2e5-4752-8f85-50998e508c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.170833 Sep 11 05:51:30.854178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1106/1976] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:31.155010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:31.157171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:31.163529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:31.164026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:31.164508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:31.165204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:31.165662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:31.166086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:31.195520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbcac42b-a03c-46e1-abd5-d475272bcbb8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Sep 11 05:51:31.196098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 871/1977] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:31.880543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:31.881194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:31.883123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:51:31.883272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe (ip 10.222.0.33) !!! Sep 11 05:51:31.889815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:31.890566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:31.891000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:31.891694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:31.892184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:31.892610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:32.031612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:32.040241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:32.041693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:32.043680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1be836d7-23ba-4cf1-95f1-eb66e76dd289 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.167000 Sep 11 05:51:32.044274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1107/1978] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:32.207948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:32.210286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:32.217314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:32.217792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:32.218227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:32.218914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:32.219393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:32.219814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:32.248474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73bf2a26-4a18-4910-a2eb-1b71584880e8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Sep 11 05:51:32.249021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 872/1979] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:33.068689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:33.069350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:33.076099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:33.076592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:33.077037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:33.077732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:33.078193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:33.078624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:33.093307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:33.204767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:33.214186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:33.215814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:33.217170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9af88eb8-5d94-481a-9ab2-dda91d0cd35f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152316 Sep 11 05:51:33.217657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1108/1980] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:33.261019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:33.263166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:33.269730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:33.270212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:33.270653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:33.271346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:33.271805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:33.272262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:33.275732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:33.302021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79a6d994-9fe4-42ce-9d17-b8862c69759a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Sep 11 05:51:33.302595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 873/1981] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:34.243600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:34.244223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:34.247219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:34.252681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:34.253169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:34.253607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:34.254305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:34.254760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:34.255186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:34.315810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:34.318533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:34.325189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:34.325670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:34.326110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:34.326816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:34.327269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:34.327687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:34.357444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb9f8feb-408d-41c2-8f8a-dfe1896612bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046317 Sep 11 05:51:34.358013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 874/1982] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:34.391688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:34.400402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:34.402064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:34.403231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d47d6521-ce9b-418d-89c6-f0fa2c3d7479 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163532 Sep 11 05:51:34.403844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1109/1983] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:35.369752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:35.372897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:35.375287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:35.380545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:35.381023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:35.381455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:35.382143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:35.382593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:35.383014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:35.412760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-13e8fc39-68b9-4b7b-a9fb-3a20522603e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Sep 11 05:51:35.413314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 875/1984] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:35.428435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:35.429050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:35.436273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:35.436757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:35.437196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:35.437892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:35.438351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:35.438776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:35.570289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:35.579154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:35.580574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:35.581737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17fb7ee2-7703-49ae-91db-2f0cbd34f06b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157179 Sep 11 05:51:35.582298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1110/1985] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:36.425882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:36.428053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:36.439447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:36.439926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:36.440385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:36.441078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:36.441525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:36.441939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:36.471248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b8ab2c5-520b-439f-8489-3035b8a6f4cf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049310 Sep 11 05:51:36.471800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 876/1986] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:36.606688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:36.607293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:36.613689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:36.614169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:36.614600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:36.615282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:36.615732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:36.616201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:36.741660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:36.750596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:36.752038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:36.753196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-586768d5-742b-454c-9694-2b16d301f86e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.150418 Sep 11 05:51:36.753750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1111/1987] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:37.482880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:37.485065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:37.491423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:37.491906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:37.492390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:37.493087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:37.493545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:37.493973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:37.523506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b65c0800-acda-49f0-a1cf-07cbc4f2c1bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Sep 11 05:51:37.524279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 877/1988] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:37.778782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:37.779313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:37.785702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:37.786190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:37.786630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:37.787323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:37.787782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:37.788250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:37.918415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:37.926981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:37.928456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:37.929622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-306b9064-19b6-48cd-a471-8ea84153931b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154849 Sep 11 05:51:37.930174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1112/1989] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:38.536524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:38.538745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:38.555011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:38.555011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:38.555011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:38.555011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:38.555728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:38.555728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:38.581895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-268f56a4-4e74-4800-bc42-79f87bcaf559 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049883 Sep 11 05:51:38.582465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 878/1990] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:38.956402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:38.957014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:38.963615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:38.964217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:38.964685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:38.965377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:38.965836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:38.966270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:39.093804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:39.102235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:39.103674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:39.105657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de7f7e47-4534-4a71-8099-8e8f03b6b0ae tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153247 Sep 11 05:51:39.106204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1113/1991] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:39.595234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:39.597333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:39.603593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:39.604107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:39.604651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:39.605346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:39.605866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:39.606291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:39.635265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f986d6a-7cbe-4255-bad2-9b87077e7a2f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Sep 11 05:51:39.636436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 879/1992] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:40.130753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:40.131356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:40.133335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:51:40.133476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe (ip 10.222.0.33) !!! Sep 11 05:51:40.140711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:40.141188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:40.141725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:40.142887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:40.143737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:40.144501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:40.273903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:40.283155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:40.284306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:40.285472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e8fe641-a45d-4bc0-8adb-ac5e04323389 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158620 Sep 11 05:51:40.286017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1114/1993] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:40.648393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:40.650599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:40.656848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:40.657317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:40.657752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:40.658508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:40.659029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:40.659453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:40.689399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b365ae68-dc5f-4adf-bca7-03d7dde9f8d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 11 05:51:40.689945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 880/1994] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:41.312398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:41.312923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:41.319157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:41.319640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:41.320098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:41.320789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:41.321240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:41.321663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:41.457991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:41.467078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:41.468544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:41.469715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84aa51d5-9a58-429f-a22d-1158228af3dc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161379 Sep 11 05:51:41.470267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1115/1995] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:41.702620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:41.704767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:41.711031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:41.711508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:41.711944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:41.712668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:41.713121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:41.713594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:41.742281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c3d9689-dac2-4102-90e3-88ba56fb2f75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Sep 11 05:51:41.742835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 881/1996] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:42.508624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:42.508624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:42.508624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:42.508624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:42.509304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:42.509304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:42.509304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:42.509304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:42.643006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:42.652210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:42.653663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:42.654854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-695717ce-c934-46c1-9c7d-c1f6343cbdea tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.164161 Sep 11 05:51:42.655449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1116/1997] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:42.754713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:42.756886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:42.763909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:42.764452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:42.764929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:42.765849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:42.766395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:42.766721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:42.798040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86a658b8-d141-42d7-9af7-3d7449850fbc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Sep 11 05:51:42.798608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 882/1998] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:43.681298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:43.681827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:43.688923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:43.689406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:43.689846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:43.690533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:43.690990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:43.691417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:43.811035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:43.813216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:43.819781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:43.820996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:43.821437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:43.822139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:43.822591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:43.823613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:43.825268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:43.835919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:43.837384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:43.839262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e4a8682-680a-473c-a262-7e5141cf38c8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161418 Sep 11 05:51:43.848052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1117/1999] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:43.854049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60ed2d87-d227-4f93-8eea-0cfb9e71c12f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Sep 11 05:51:43.854600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 883/2000] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:44.865241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:44.865892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:44.867821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:44.871195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:44.872633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:44.873112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:44.873554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:44.874251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:44.874898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:44.875328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:44.877779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:44.878261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:44.878693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:44.879385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:44.879961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:44.880416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:44.911654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d73691ba-841b-40b3-8299-19f558b3ca93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049666 Sep 11 05:51:44.912447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 884/2001] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:45.003413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:45.012303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:45.013735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:45.014894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f46b7b0-3368-499d-a33b-9ee73faf87c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154440 Sep 11 05:51:45.015707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1118/2002] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:46.006460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:46.008920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:46.014909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:46.015659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:46.016132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:46.016828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:46.017284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:46.017710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:46.048069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39c373d5-e026-4a7a-9ee9-213cec57243c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127730 Sep 11 05:51:46.049065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 885/2003] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:46.113520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:46.114135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:46.120409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:46.120896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:46.121335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:46.122019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:46.122470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:46.122892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:46.295656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:46.304225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:46.305674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:46.306842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22886b73-d86a-4994-a37c-3b0236a1b534 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.270203 Sep 11 05:51:46.307408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1119/2004] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:51:47.060983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:47.063127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:47.069373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:47.069844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:47.070279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:47.070959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:47.071404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:47.071819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:47.101245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a4030263-77a7-4e0d-bcf3-7dc76bb15198 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Sep 11 05:51:47.101785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 886/2005] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:47.332195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:47.332806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:47.340222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:47.340747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:47.341192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:47.341898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:47.342360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:47.342795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:47.468853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:47.477405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:47.478866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:47.480771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-600e77ed-18e0-44e0-9a13-490106b913ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152449 Sep 11 05:51:47.481337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1120/2006] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:48.113850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:48.116040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:48.122616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:48.123106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:48.123549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:48.124272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:48.124731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:48.125162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:48.155567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c119905-1fc3-40f3-9fc0-63b2319f093a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Sep 11 05:51:48.156157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 887/2007] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:48.505965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:48.506585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:48.514237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:48.514724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:48.515165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:48.516133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:48.516591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:48.517058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:48.646311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:48.655520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:48.657015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:48.658215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffb7828f-f138-4f9c-916b-5701bb32dc83 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156386 Sep 11 05:51:48.658780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1121/2008] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:49.168412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:49.170533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:49.176749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:49.177224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:49.177657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:49.178335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:49.178784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:49.179204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:49.208923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e4a6c1b-1313-4822-b3ea-624026ac5948 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Sep 11 05:51:49.209465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 888/2009] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:49.684038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:49.684628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:49.691001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:49.691476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:49.691908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:49.692615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:49.693065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:49.693508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:49.826268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:49.835612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:49.837108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:49.838343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82a7cd1b-48e2-4759-808c-287d9ff885e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158999 Sep 11 05:51:49.838894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1122/2010] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:50.221419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:50.223555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:50.230639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:50.231118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:50.231558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:50.232266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:50.232723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:50.233149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:50.258146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:50.264253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfdacaec-6b09-46ac-80d1-a684752ecda4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Sep 11 05:51:50.264807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 889/2011] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:50.862508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:50.863202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:50.869865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:50.870489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:50.870929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:50.871624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:50.872109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:50.872656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:51.009051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:51.018531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:51.019979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:51.021163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2ee789b-3f93-47fb-95b8-4a3ca34ed174 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162541 Sep 11 05:51:51.021724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1123/2012] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:51.276692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:51.278811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:51.285285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:51.285759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:51.286191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:51.286888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:51.287316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:51.287733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:51.316550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69b18362-bf25-437e-be2e-ab5734bc80f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Sep 11 05:51:51.317095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 890/2013] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:52.058989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:52.058989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:52.058989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:52.058989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:52.059726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:52.059726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:52.059726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:52.060154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:52.194091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:52.202709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:52.204187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:52.205354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ece35fb2-dd39-4015-b36b-3401bf050016 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161907 Sep 11 05:51:52.205905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1124/2014] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:52.329308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:52.331568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:52.338008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:52.339147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:52.339587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:52.340313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:52.340770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:52.341202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:52.370186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc1033e4-4a9a-4f71-b225-6ff91a9f5a60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Sep 11 05:51:52.370739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 891/2015] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:53.231149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:53.231796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:53.238262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:53.238747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:53.239183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:53.239876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:53.240355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:53.240782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:53.245349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:51:53.369404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:53.378416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:53.379876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:53.381085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7acc504-e560-41db-a366-8a0cdb540cb4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154371 Sep 11 05:51:53.381630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1125/2016] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:53.384310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:53.387243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:53.393510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:53.394096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:53.394534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:53.395256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:53.395705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:53.396167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:53.425529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af56cedf-758a-406b-b7ce-1a35fc74f280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 Sep 11 05:51:53.426099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 892/2017] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:54.407628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:54.408272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:54.414664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:54.415152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:54.415593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:54.416318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:54.416782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:54.417787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:54.438419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:54.440718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:54.446619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:54.447103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:54.447538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:54.448312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:54.448784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:54.449205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:54.478718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c4c2fed-7cba-4850-bcf1-b4871cf8a30a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Sep 11 05:51:54.479281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 893/2018] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:51:54.545974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:54.554560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:54.556035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:54.557213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce1fae64-02a9-48db-8123-e9e802e1e7e4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153564 Sep 11 05:51:54.557803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1126/2019] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:55.490947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:55.493301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:55.500431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:55.500916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:55.501356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:55.502059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:55.502520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:55.502942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:55.532617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01450825-d4a2-4fdf-a197-2f92fce5ac60 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Sep 11 05:51:55.533188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 894/2020] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:55.582431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:55.583050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:55.589664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:55.590149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:55.590591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:55.591292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:55.591809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:55.592221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:55.957094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:55.966098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:55.967539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:55.968734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56e14a19-77c9-46f3-9662-3ce9f8863113 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.390146 Sep 11 05:51:55.969291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1127/2021] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:56.545800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:56.548697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:56.555085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:56.555569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:56.556027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:56.556738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:56.557199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:56.557649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:56.587069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-923fa4ef-a984-477f-9a8f-aada06173ddc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Sep 11 05:51:56.587620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 895/2022] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:56.993831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:56.994386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:57.000827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:57.001305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:57.001736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:57.002416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:57.002866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:57.003289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:57.129570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:57.138329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:57.139753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:57.141195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3283b51-baa4-4609-851b-85dcd61f540e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151340 Sep 11 05:51:57.141742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1128/2023] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:57.600155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:57.602353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:57.613564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:57.613564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:57.613564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:57.613564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:57.613917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:57.613917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:57.641740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-509e212b-f543-49b6-ba16-82d9619a4bba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Sep 11 05:51:57.642297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 896/2024] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:58.166631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:58.167818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:58.174230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:58.174705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:58.175135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:58.175811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:58.176288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:58.176712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:58.309454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:58.318286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:58.319738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:58.320931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f05cd203-ae1e-437b-a8cd-f968cf842c35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158147 Sep 11 05:51:58.321483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1129/2025] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:58.654260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:58.656319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:58.662942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:58.663439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:58.663887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:58.664621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:58.665078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:58.665510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:58.697054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b95c54f5-ed61-4968-bd09-97592dc22485 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Sep 11 05:51:58.697632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 897/2026] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:51:59.346184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:59.346798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:59.353031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:59.353510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:59.353940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:59.355353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:59.356115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:59.356548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:59.485335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:59.493793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:59.495312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:51:59.496523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3463fbd-8302-4a80-85f7-b5d80b0fa8e1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154211 Sep 11 05:51:59.497085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1130/2027] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:51:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:51:59.709565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:51:59.711822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:51:59.718760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:59.719239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:59.719675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:59.720392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:51:59.720843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:51:59.721265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:51:59.751788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e62251e6-539a-446d-9d6a-2b6baad63ea4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Sep 11 05:51:59.752380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 898/2028] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:51:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:00.522014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:00.522633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:00.529988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:00.530480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:00.530918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:00.531614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:00.532105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:00.532522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:00.667548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:00.676278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:00.677716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:00.678873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ce352bc-b9d0-4bc8-acc0-c8b5df455afd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161032 Sep 11 05:52:00.679417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1131/2029] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:00.765095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:00.767609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:00.773450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:00.773922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:00.774367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:00.775078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:00.775531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:00.775953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:00.806571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78d84925-76d7-469c-bb39-30a87b890142 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Sep 11 05:52:00.806812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 899/2030] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:01.705073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:01.705656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:01.712015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:01.712568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:01.713001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:01.713705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:01.714478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:01.715021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:01.819756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:01.822355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:01.829811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:01.830557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:01.831480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:01.832397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:01.833590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:01.834020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:01.851513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:01.862155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:01.864055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:01.865240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-682c2494-3c9a-4358-b75c-81cabee8156f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.164099 Sep 11 05:52:01.865790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1132/2031] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:01.884901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9f2ad26-98ad-4ba3-88ae-a1491101c4ee tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070228 Sep 11 05:52:01.885465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 900/2032] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:02.891302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:02.892244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:02.897466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:02.898664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:02.899155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:02.899592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:02.900551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:02.900966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:02.901107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:02.901441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:02.908317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:02.908966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:02.909618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:02.910385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:02.910903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:02.911688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:02.942714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5eb1f22b-974f-483f-8c3f-32237526aa2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Sep 11 05:52:02.943285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 901/2033] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:03.036692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:03.046133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:03.047562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:03.048784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84a96421-94a7-4741-a907-a2e9e53088f2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161639 Sep 11 05:52:03.049336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1133/2034] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:03.954734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:03.956986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:03.963245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:03.964300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:03.964754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:03.965452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:03.966024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:03.966323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:03.996740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f723020b-cfcd-4cc7-8e3b-2c8c3a598fd4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Sep 11 05:52:03.997300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 902/2035] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:04.074937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:04.075567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:04.082010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:04.082491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:04.082929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:04.083613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:04.084094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:04.084517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:04.211581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:04.220940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:04.222388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:04.223552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e79afd4-b4b7-4c5b-a273-7b837b97d1eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153329 Sep 11 05:52:04.224131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1134/2036] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:05.008878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:05.011584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:05.018170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:05.018656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:05.019097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:05.019805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:05.020300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:05.020731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:05.050963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32ba19f5-58a8-47a6-9ed7-863eafb7ac2d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Sep 11 05:52:05.051528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 903/2037] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:05.253217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:05.253800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:05.256132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:05.262400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:05.262883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:05.263332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:05.264068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:05.264533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:05.264971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:05.391465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:05.399988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:05.401535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:05.402691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b1646ad-f087-4b50-bf46-16b5f704c640 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153478 Sep 11 05:52:05.403255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1135/2038] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:06.063820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:06.065994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:06.069851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:06.073431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:06.073920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:06.074363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:06.075068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:06.075528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:06.075954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:06.108064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b7714152-503b-4038-bf12-ec66988bf333 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048316 Sep 11 05:52:06.108801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 904/2039] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:06.427122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:06.427718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:06.434263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:06.434738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:06.435204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:06.435890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:06.436379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:06.436803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:06.567731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:06.576853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:06.578305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:06.579474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34b9d13d-d6bc-4d45-9a8d-7bb148b7bbc9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156287 Sep 11 05:52:06.580058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1136/2040] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:07.119598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:07.122930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:07.129422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:07.129905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:07.130341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:07.131033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:07.131485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:07.131903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:07.161058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2383c346-eec0-417f-88dd-5c64667771d8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Sep 11 05:52:07.161621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 905/2041] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:07.604911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:07.605587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:07.611929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:07.612445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:07.612883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:07.613566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:07.614022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:07.614449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:07.743822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:07.752794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:07.754313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:07.755485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27199570-936e-46b8-b96c-d6b02b3ce9b7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155188 Sep 11 05:52:07.756068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1137/2042] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:08.173279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:08.175331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:08.181893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:08.182403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:08.182845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:08.183537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:08.183987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:08.184428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:08.199196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:08.216615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ad3e78c-5bea-40fa-8060-88fca07417f6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Sep 11 05:52:08.217178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 906/2043] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:08.781231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:08.781874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:08.788617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:08.789101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:08.789544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:08.790236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:08.790691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:08.791119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:08.926748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:08.936040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:08.937490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:08.938657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8aa59c9b-9ebf-491c-a699-bdc3709754f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161361 Sep 11 05:52:08.939212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1138/2044] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:52:09.228360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:09.231051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:09.237318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:09.237794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:09.238229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:09.238913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:09.239446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:09.239873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:09.269692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-311ea93b-fca9-4416-b716-98212baa7a7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Sep 11 05:52:09.270586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 907/2045] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:09.963837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:09.965055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:09.971512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:09.972014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:09.972601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:09.973290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:09.973743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:09.974171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:10.103781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:10.113110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:10.114394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:10.115554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-411248f9-0c1f-4a7a-9711-6959bb2cffe3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155659 Sep 11 05:52:10.116122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1139/2046] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:10.282194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:10.284422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:10.290719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:10.291196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:10.291632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:10.292357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:10.293434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:10.293868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:10.329283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b87da889-8f5c-4e94-9a38-fe2e70893870 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051044 Sep 11 05:52:10.334194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 908/2047] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:11.141459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:11.142069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:11.148916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:11.149403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:11.149836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:11.150529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:11.150983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:11.151408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:11.310093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:11.318927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:11.320407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:11.321587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af8ea691-daf8-45e4-b03f-c917dce0abd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.184266 Sep 11 05:52:11.322178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1140/2048] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:11.342915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:11.345259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:11.351697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:11.352230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:11.352666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:11.353368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:11.353821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:11.354250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:11.392977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7f3ad51f-3efc-47df-96d6-594ad25a950e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050335 Sep 11 05:52:11.397691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 909/2049] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:12.350938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:12.351557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:12.358770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:12.359263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:12.359712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:12.360471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:12.360928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:12.361355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:12.405731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:12.407872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:12.414358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:12.414841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:12.415278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:12.415968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:12.416451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:12.416869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:12.450523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28f647ed-9172-45fc-8c83-cc9bb4825a07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Sep 11 05:52:12.451717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 910/2050] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:12.494837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:12.497649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:12.505638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:12.507347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:12.508564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e04e8e7-2baa-4ca7-a494-6238bad09f9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161571 Sep 11 05:52:12.509118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1141/2051] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:13.463441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:13.465791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:13.472441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:13.472933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:13.473383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:13.474099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:13.474557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:13.474983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:13.504604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe228c61-99ef-433c-b8b0-68332bc840fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Sep 11 05:52:13.505172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 911/2052] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:13.533981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:13.534696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:13.541405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:13.541950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:13.542386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:13.543095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:13.543615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:13.544321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:13.674661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:13.683197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:13.685222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:13.686448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93f4d66c-2a23-44a3-b768-fdb6ac55fbfb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156331 Sep 11 05:52:13.686995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1142/2053] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:14.517832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:14.519889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:14.526272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:14.526751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:14.527218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:14.527906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:14.529062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:14.529495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:14.558987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c3e26fca-0df2-410a-bab8-242e2831fe66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Sep 11 05:52:14.559628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 912/2054] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:14.712141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:14.712766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:14.719301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:14.719777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:14.720245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:14.720925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:14.721375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:14.721794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:14.853321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:14.862709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:14.864203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:14.865441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d29bb352-f58d-4fbe-a4f4-d7ec525595e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157154 Sep 11 05:52:14.866040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1143/2055] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:15.570928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:15.573012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:15.579922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:15.580439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:15.580890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:15.581582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:15.582077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:15.582526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:15.612355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49ef08ca-d962-49e7-82c7-7f08bebebe82 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Sep 11 05:52:15.612923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 913/2056] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:15.891737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:15.892306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:15.898854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:15.899340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:15.899777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:15.900492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:15.900948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:15.901374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:16.028458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:16.038393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:16.039828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:16.041018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-749783ba-031d-473d-b4a6-1d086e547f6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154217 Sep 11 05:52:16.041771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1144/2057] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:16.625296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:16.627440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:16.629435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:52:16.629578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 05:52:16.636756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:16.637321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:16.638365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:16.639095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:16.639546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:16.639972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:16.670700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12db546a-1809-4a22-b1c0-373d98b07fa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049838 Sep 11 05:52:16.671265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 914/2058] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:17.067427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:17.068064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:17.074527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:17.076141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:17.076643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:17.077341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:17.077794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:17.078217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:17.208555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:17.217523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:17.218954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:17.220126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50fd87ec-935e-447b-8da3-6e0c26a4becc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156602 Sep 11 05:52:17.220675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1145/2059] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:17.683052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:17.686134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:17.692543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:17.693019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:17.693451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:17.694128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:17.694606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:17.695025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:17.723532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-902a91bd-8390-4c0f-8040-902dcd911d33 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Sep 11 05:52:17.724359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 915/2060] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:18.245233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:18.245880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:18.252464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:18.252951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:18.253392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:18.254083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:18.254538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:18.254963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:18.382207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:18.391643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:18.393115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:18.394313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cf33c23-e6c4-481d-858b-38bdcfb58b5e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152963 Sep 11 05:52:18.394871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1146/2061] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:18.736019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:18.738138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:18.744471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:18.744976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:18.745406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:18.746135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:18.746534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:18.747491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:18.785374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9fc4b710-c5b6-4732-8224-7a17f4fd3f44 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053287 Sep 11 05:52:18.786108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 916/2062] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:19.420794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:19.421435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:19.427859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:19.428375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:19.428813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:19.429503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:19.429961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:19.430391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:19.559746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:19.568956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:19.570393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:19.571565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45f21cf2-8acf-4ed4-8fb4-0f61ab1b7562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154713 Sep 11 05:52:19.572157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1147/2063] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:19.798815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:19.800988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:19.807315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:19.807805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:19.808274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:19.808964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:19.810250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:19.810814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:19.843165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b47cf34c-089f-464f-87fb-977fa0e054ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048657 Sep 11 05:52:19.843747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 917/2064] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:20.597687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:20.598297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:20.604603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:20.605093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:20.605531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:20.606327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:20.606810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:20.607295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:20.739518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:20.748658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:20.750095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:20.751247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6595cb8-8998-4362-9f9d-c0ad7e3a768f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157522 Sep 11 05:52:20.751786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1148/2065] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:20.854992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:20.857146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:20.863453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:20.863929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:20.864398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:20.865089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:20.865544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:20.865968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:20.895201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39d4dc0f-0949-4e73-82fe-5b1bf07f5f89 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Sep 11 05:52:20.895749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 918/2066] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:21.777433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:21.778240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:21.784629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:21.785115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:21.785558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:21.786251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:21.786705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:21.787129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:21.907237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:21.909399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:21.915635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:21.916152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:21.916584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:21.917274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:21.917725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:21.918173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:21.918289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:21.929555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:21.931027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:21.932243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-844a043f-f51e-4885-b8fa-6fc8d67ed3e0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158631 Sep 11 05:52:21.936321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1149/2067] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:21.948339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-912574f8-cf2a-4e13-a76b-e115f3add224 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Sep 11 05:52:21.948900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 919/2068] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:22.958540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:22.959161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:22.960242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:22.962417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:22.966108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:22.966686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:22.967178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:22.967872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:22.968354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:22.968839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:22.969964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:22.970440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:22.970876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:22.972224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:22.972665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:22.973087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:23.002542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6d77d3a-f1b2-4924-9287-f9e830291d04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Sep 11 05:52:23.003085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 920/2069] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:23.108905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:23.117363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:23.118789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:23.119939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-711b3bab-9695-4259-861b-b69e398eaa80 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.165655 Sep 11 05:52:23.120521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1150/2070] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:24.014813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:24.017152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:24.023429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:24.023908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:24.024368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:24.025051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:24.025503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:24.025925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:24.055835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dad449e1-b7da-4f01-b8c4-787bc2ef45fd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Sep 11 05:52:24.056398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 921/2071] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:24.145772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:24.146411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:24.153258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:24.154151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:24.154650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:24.155381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:24.155875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:24.156372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:24.285388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:24.294813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:24.296289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:24.297457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25bbc284-0c43-4b0f-8372-ffd5b87cfa11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155568 Sep 11 05:52:24.298012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1151/2072] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:25.068620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:25.070797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:25.077763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:25.078251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:25.078694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:25.079390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:25.079847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:25.080308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:25.109797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23789203-1002-4901-ae5b-11122b4070a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Sep 11 05:52:25.110352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 922/2073] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:25.325374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:25.325934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:25.332418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:25.332897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:25.333331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:25.334020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:25.334471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:25.334900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:25.467089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:25.475646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:25.477159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:25.478325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be93c3ac-d110-4229-ac8f-de1bff5b1eeb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157716 Sep 11 05:52:25.478894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1152/2074] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:26.121344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:26.124131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:26.130405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:26.130885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:26.131325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:26.132040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:26.132499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:26.132922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:26.136425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:26.162746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b78e5af2-f9a0-4b92-a160-73d7913b8a38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Sep 11 05:52:26.163301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 923/2075] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:26.503905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:26.504472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:26.510882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:26.511363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:26.511801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:26.513167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:26.513661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:26.514091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:26.642227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:26.650663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:26.652142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:26.653918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa1e859a-3c85-4916-ae00-5549ba13f66d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154078 Sep 11 05:52:26.654470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1153/2076] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:27.175068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:27.177265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:27.183517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:27.184585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:27.185071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:27.185763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:27.186218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:27.186644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:27.215575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8df97904-4027-446f-ab72-510e06db4e42 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Sep 11 05:52:27.216322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 924/2077] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:27.678881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:27.679493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:27.686184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:27.686666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:27.687175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:27.687865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:27.688353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:27.688782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:27.817173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:27.826385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:27.827823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:27.829014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cb5446c-f693-4653-a2ba-ed00bda1a063 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154038 Sep 11 05:52:27.829575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1154/2078] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:28.228259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:28.230439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:28.238347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:28.239239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:28.239815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:28.240553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:28.241014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:28.241448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:28.271557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e46db7f4-77b4-4398-93fc-a4c718a42036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Sep 11 05:52:28.272139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 925/2079] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:28.854116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:28.854733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:28.860782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:28.861269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:28.861705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:28.862392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:28.862846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:28.863274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:28.997140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:29.005648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:29.007087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:29.008289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-834973de-5410-40a0-95a9-e2d17aaccc5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158243 Sep 11 05:52:29.008844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1155/2080] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:29.284591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:29.287039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:29.293891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:29.294707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:29.295147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:29.295838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:29.296321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:29.296744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:29.325613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ba1c56c-bca8-4e8c-a60d-ae4ad3c8eaf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Sep 11 05:52:29.326100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 926/2081] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:30.034204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:30.034817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:30.041174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:30.041647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:30.042080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:30.042755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:30.043240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:30.043972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:30.169526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:30.178020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:30.179453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:30.180634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9eaa5f96-d767-434b-97a0-12ce823cb571 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.150407 Sep 11 05:52:30.181193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1156/2082] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:30.337571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:30.339740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:30.346123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:30.346610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:30.347046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:30.347742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:30.348247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:30.348872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:30.380292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8fd62b9-f9bc-49a4-8124-2f9172814967 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Sep 11 05:52:30.380846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 927/2083] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:31.206594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:31.207234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:31.213586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:31.214064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:31.214493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:31.215973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:31.216659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:31.217089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:31.351558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:31.360532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:31.361976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:31.363143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4781855-730b-4de5-b420-c89d5d2e8053 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160478 Sep 11 05:52:31.363698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1157/2084] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:31.394112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:31.396279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:31.402626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:31.403378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:31.403937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:31.404665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:31.405118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:31.405658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:31.435969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07602a79-16ce-4304-ae91-9dfcb5f49ed4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Sep 11 05:52:31.436856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 928/2085] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:32.387775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:32.388421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:32.395381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:32.395890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:32.396371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:32.397172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:32.397494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:32.397916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:32.412961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:32.450662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:32.453531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:32.461387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:32.462463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:32.463086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:32.464336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:32.465516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:32.466104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:32.498426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f57e768e-0f39-4aaa-b6fe-fccad85ca724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053190 Sep 11 05:52:32.499026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 929/2086] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:32.546270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:32.554720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:32.556517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:32.557978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd3a486a-5022-42f5-82b7-30b1a83c2936 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.174076 Sep 11 05:52:32.572047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1158/2087] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:33.510839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:33.513261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:33.520022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:33.520628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:33.521107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:33.521822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:33.522284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:33.522754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:33.554273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a633cc50-a698-42a5-8bd8-34c06496a80b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047377 Sep 11 05:52:33.555029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 930/2088] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:33.584853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:33.586862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:33.594707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:33.595190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:33.595623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:33.596347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:33.596800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:33.597286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:33.739214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:33.748366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:33.749796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:33.750957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9514964e-dca8-4b67-bae2-90803399b985 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.170440 Sep 11 05:52:33.751632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1159/2089] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:34.567122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:34.569315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:34.576672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:34.576996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:34.577447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:34.578160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:34.578622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:34.579053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:34.609521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-851e3f49-9224-439f-87ef-f48884eb3b08 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046255 Sep 11 05:52:34.610088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 931/2090] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:34.776753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:34.777392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:34.784041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:34.784535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:34.784978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:34.785670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:34.786142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:34.786560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:34.918691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:34.927253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:34.928734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:34.929889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59b0dcc1-7cb1-4408-b7c2-a8c98ba887fc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157098 Sep 11 05:52:34.930448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1160/2091] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:35.621994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:35.624189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:35.630532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:35.631100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:35.631551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:35.632372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:35.632838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:35.633270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:35.663879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5dd0ad61-818c-4eaf-8668-d1c05e0a2840 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Sep 11 05:52:35.664480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 932/2092] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:35.955955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:35.956592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:35.958878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:35.964634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:35.966248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:35.966694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:35.967389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:35.967845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:35.968299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:36.094300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:36.103212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:36.104677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:36.106686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7edaa7aa-4e91-4228-b4d9-f6aed5cd2df7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154804 Sep 11 05:52:36.107433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1161/2093] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:36.676362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:36.678483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:36.681769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:36.687286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:36.687768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:36.688231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:36.688927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:36.689378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:36.689803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:36.720806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3bd041de-2875-4b96-8080-1ac4017fdd37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048273 Sep 11 05:52:36.721374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 933/2094] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:37.132044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:37.132664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:37.139680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:37.140186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:37.140898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:37.141588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:37.142043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:37.142469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:37.272314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:37.281492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:37.282933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:37.284122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f928be0d-e1b5-45d0-a4d6-be730c6810a9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155961 Sep 11 05:52:37.284686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1162/2095] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:37.733466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:37.735815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:37.741777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:37.742256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:37.742690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:37.743387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:37.743835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:37.744286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:37.775417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11f2e79a-baa4-43a9-9834-65fd6cb376b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Sep 11 05:52:37.775976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 934/2096] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:38.309204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:38.309821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:38.316793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:38.317277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:38.317712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:38.318404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:38.318853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:38.319274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:38.450062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:38.458527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:38.459972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:38.461158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8468dee-d3ce-4ea7-bf4d-05216a748cf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155862 Sep 11 05:52:38.461714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1163/2097] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:38.786775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:38.788980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:38.795473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:38.795962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:38.796440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:38.797147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:38.797750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:38.798028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:38.830436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-554d03db-563a-4271-81b5-a2558112b737 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Sep 11 05:52:38.831015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 935/2098] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:39.485701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:39.486320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:39.492791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:39.493278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:39.493725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:39.494414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:39.494871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:39.495298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:39.628191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:39.637349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:39.639147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:39.640329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e26f5e2-33a4-47ea-9314-69ab231f7bbc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158530 Sep 11 05:52:39.641147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1164/2099] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:39.843001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:39.845219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:39.851613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:39.852206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:39.852712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:39.853470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:39.853989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:39.854500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:39.885971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c45c2de9-683b-4bc9-a409-cf26283ca542 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047267 Sep 11 05:52:39.887730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 936/2100] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:40.666833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:40.667375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:40.674488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:40.674974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:40.675410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:40.676145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:40.676602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:40.677032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:40.806923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:40.815771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:40.817297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:40.818456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9f1aa29-2747-4422-8a96-c54633be68b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155668 Sep 11 05:52:40.819011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1165/2101] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:40.898921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:40.901089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:40.908140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:40.908620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:40.909050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:40.909737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:40.910184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:40.910602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:40.939709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fcb50cf4-71cb-4142-b4d9-2e0a60971bf8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Sep 11 05:52:40.940310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 937/2102] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:41.844707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:41.845317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:41.851667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:41.852196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:41.852633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:41.853322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:41.853780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:41.854206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:41.952875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:41.956323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:41.963967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:41.965293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:41.965738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:41.966631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:41.967087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:41.967507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:41.989668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:41.999275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd6adc10-2594-4a84-8efa-9b24bb5c45a8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Sep 11 05:52:41.999827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:41.999981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 938/2103] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:42.001306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:42.002469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f1bd92b-372b-40b1-9fc3-6c472b6a222e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161736 Sep 11 05:52:42.003092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1166/2104] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:43.011388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:43.014264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:43.020879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:43.021367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:43.021808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:43.022508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:43.022964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:43.023597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:43.028309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:43.028936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:43.035243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:43.035734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:43.036230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:43.036933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:43.037395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:43.039080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:43.048865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:43.054695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8febe69d-3efd-411b-b0ff-43d39187679b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Sep 11 05:52:43.055453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 939/2105] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:43.188444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:43.197096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:43.198546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:43.199763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0319fe1e-7954-4efe-972b-7acf83ce7b9a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.175627 Sep 11 05:52:43.200355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1167/2106] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:44.067609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:44.069840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:44.077161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:44.077647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:44.078092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:44.078794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:44.079255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:44.079682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:44.111507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c02aab45-0820-417e-bae1-aa1874a71c6a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Sep 11 05:52:44.112441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 940/2107] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:44.224641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:44.225263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:44.231763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:44.232352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:44.232879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:44.233585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:44.234229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:44.234735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:44.363532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:44.372846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:44.374299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:44.375469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8addd208-9a3c-4937-9c01-2c863c0c39a4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154692 Sep 11 05:52:44.376043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1168/2108] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:45.124655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:45.126765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:45.133211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:45.133693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:45.134129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:45.134819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:45.135267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:45.135685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:45.166396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17b2ec73-4f57-4435-88a3-9db403f6ea36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Sep 11 05:52:45.168046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 941/2109] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:45.401497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:45.402064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:45.408466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:45.408946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:45.409385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:45.410072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:45.410526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:45.410952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:45.540719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:45.549980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:45.551422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:45.552605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48d8644a-86c7-4d1a-8a27-afe5b55ea021 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155085 Sep 11 05:52:45.553166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1169/2110] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:46.179274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:46.181419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:46.188740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:46.189219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:46.189661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:46.190352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:46.190801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:46.191218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:46.221998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-604539af-5e88-4490-960f-abfdb0b89a32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Sep 11 05:52:46.222551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 942/2111] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:46.577886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:46.578538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:46.584931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:46.585419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:46.585873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:46.586542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:46.586999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:46.587422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:46.717549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:46.726191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:46.727632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:46.728823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ccc3bf0e-9b64-4ed9-866e-307a826910db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155133 Sep 11 05:52:46.729448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1170/2112] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:47.234213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:47.236368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:47.242577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:47.243058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:47.243499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:47.244233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:47.244689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:47.245113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:47.278338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b079f612-4367-47c4-bda0-fd9f20eb58b1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 Sep 11 05:52:47.279093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 943/2113] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:47.754897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:47.755482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:47.762072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:47.762549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:47.762990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:47.763681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:47.764169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:47.764600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:47.892324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:47.900836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:47.902846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:47.904019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af47269-b47a-4693-925d-736d609ee514 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153155 Sep 11 05:52:47.904582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1171/2114] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:48.290818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:48.293796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:48.300308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:48.300789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:48.301224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:48.301917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:48.302395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:48.302828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:48.333355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29545538-6175-4603-9d0f-318034fed08a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Sep 11 05:52:48.333967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 944/2115] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:48.929692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:48.930251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:48.937230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:48.937707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:48.938141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:48.938824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:48.939272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:48.939693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:49.070696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:49.079873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:49.081332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:49.082494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12932fa4-55d7-49c0-b543-196b7b1c4d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156818 Sep 11 05:52:49.083047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1172/2116] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:49.346131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:49.348358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:49.354854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:49.355295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:49.355732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:49.356454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:49.356904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:49.357356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:49.386059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f9e1286-100e-4b44-a672-88bcd32ab96c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Sep 11 05:52:49.387280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 945/2117] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:50.109480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:50.110090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:50.116470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:50.116956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:50.117395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:50.118085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:50.118541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:50.118964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:50.249898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:50.258499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:50.259950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:50.261137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ae4081a-3b1c-47c2-8613-bfc1fab7b9ca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156279 Sep 11 05:52:50.261822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1173/2118] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:50.399694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:50.401798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:50.408802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:50.409661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:50.409799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:50.410505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:50.410959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:50.411670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:50.441654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b4ce318-fcd3-4a9f-9d17-4842a8c7ed50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046044 Sep 11 05:52:50.442215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 946/2119] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:51.286886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:51.287502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:51.294707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:51.295194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:51.295632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:51.296359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:51.296825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:51.297251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:51.426956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:51.435523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:51.437006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:51.438173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b67682bd-8146-48b0-9e45-0621e5410fc4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155205 Sep 11 05:52:51.438724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1174/2120] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:51.454138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:51.456349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:51.462649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:51.463138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:51.463579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:51.464321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:51.465475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:51.465897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:51.495030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28664fbd-c808-4711-b9bc-d977fb7aa58f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Sep 11 05:52:51.499836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 947/2121] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:52.463609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:52.464771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:52.471170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:52.471654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:52.472119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:52.472815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:52.473269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:52.473694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:52.477578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:52:52.507570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:52.509738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:52.516526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:52.517014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:52.517453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:52.518164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:52.518623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:52.519056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:52.552250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2dcebdb6-d9c7-43c9-85cd-fd6efec264c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048535 Sep 11 05:52:52.552838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 948/2122] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:52:52.610668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:52.619627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:52.621134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:52.622313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88d1d96c-a26f-4853-916f-c9536365e03c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162695 Sep 11 05:52:52.622880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1175/2123] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:53.564956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:53.567090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:53.573470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:53.574669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:53.575117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:53.575818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:53.576305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:53.576737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:53.606151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1b691fd-8f80-4133-8e3f-ec71ffdf00be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Sep 11 05:52:53.606724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 949/2124] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:53.647437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:53.648186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:53.655547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:53.656077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:53.656527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:53.657317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:53.657781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:53.658414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:53.805157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:53.814817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:53.816342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:53.817571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-526fe90b-cb7b-46d7-b0d1-c6eb1ec2c526 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.174106 Sep 11 05:52:53.818141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1176/2125] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:54.618604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:54.620780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:54.627304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:54.627784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:54.628257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:54.628945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:54.629399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:54.629824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:54.659519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df46761c-a13d-41d1-a541-eba3861225b6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Sep 11 05:52:54.660091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 950/2126] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:54.843166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:54.843778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:54.850373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:54.850862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:54.851295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:54.851986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:54.852464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:54.852892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:54.981404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:54.989918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:54.991363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:54.992589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d427e9fe-8e54-4ed8-a46e-ed41af98eaa2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153836 Sep 11 05:52:54.993121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1177/2127] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:55.672235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:55.674338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:55.680799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:55.681274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:55.681710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:55.682388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:55.682837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:55.683951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:55.713278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd1d9ee8-26ad-4995-b537-fa32ca1704fb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Sep 11 05:52:55.713825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 951/2128] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:56.018136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:56.018750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:56.025105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:56.025585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:56.026021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:56.026742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:56.027200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:56.027620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:56.155428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:56.164123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:56.165561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:56.166718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1b88ab8-bc25-4b60-9212-68970809a39f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152714 Sep 11 05:52:56.167351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1178/2129] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:56.725738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:56.727963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:56.734389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:56.734873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:56.735317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:56.736020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:56.736492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:56.736920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:56.766030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dba1b156-ae13-41e9-b46f-1c07109e4635 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Sep 11 05:52:56.766585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 952/2130] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:57.192068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:57.192691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:57.199304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:57.199785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:57.200319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:57.201025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:57.201463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:57.201888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:57.331217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:57.340502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:57.341955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:57.343115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-330bbea4-799d-40ee-99d7-95eb36540eb8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154998 Sep 11 05:52:57.343677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1179/2131] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:57.778645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:57.780775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:57.787007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:57.787482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:57.787914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:57.788627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:57.789072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:57.789490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:57.819851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a97ee00a-253a-48de-954e-332a00ee46a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Sep 11 05:52:57.820446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 953/2132] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:58.367933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:58.368576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:58.375233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:58.375718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:58.376184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:58.376877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:58.377331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:58.377756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:58.554335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:58.563315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:58.564793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:58.565961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-019a5527-d6dd-412c-bd9b-d07fc5130d04 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.202000 Sep 11 05:52:58.566529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1180/2133] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:58.833145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:58.835344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:58.841796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:58.842273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:58.842715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:58.843427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:58.843882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:58.844337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:58.875126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e7a8f65-34ae-4d71-9ca6-e4966bbadbe4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Sep 11 05:52:58.875694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 954/2134] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:52:59.592894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:59.593507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:59.599502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:59.599986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:59.600454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:59.601138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:59.601593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:59.602019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:59.735909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:59.744492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:59.745911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:52:59.747051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55371e74-e6bc-4e53-a04a-67201b2ae42f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158292 Sep 11 05:52:59.748422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1181/2135] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:52:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:52:59.887341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:52:59.890049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:52:59.896748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:59.897226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:59.897663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:59.898355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:52:59.898811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:52:59.899233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:52:59.928570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a43ff80-b702-4cc5-9ec8-91391235aa0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Sep 11 05:52:59.929113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 955/2136] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:52:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:53:00.773929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:00.774538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:00.781575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:00.782058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:00.782497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:00.783181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:00.783636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:00.784087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:00.909265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:00.917817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:00.919761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:00.920943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4fb0209-32e9-49a2-ae71-c3d747c20b59 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151069 Sep 11 05:53:00.921496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1182/2137] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:00.941283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:00.943410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:00.949223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:00.949700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:00.950135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:00.950893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:00.951344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:00.951768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:00.964976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:00.980495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fae846e7-cf90-4dc7-b3a8-a7085e2fe268 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Sep 11 05:53:00.981073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 956/2138] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:53:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:53:01.946426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:01.947025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:01.953807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:01.954301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:01.954745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:01.955443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:01.955899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:01.956366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:01.993678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:01.995859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:02.002765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:02.003245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:02.003683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:02.004410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:02.004861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:02.005286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:02.036344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccb45f4c-010b-4f93-abfc-0693f299f0e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046425 Sep 11 05:53:02.036851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 957/2139] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:53:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:53:02.090433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:02.100341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:02.101903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:02.103078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c406624-1f65-48e6-b2e3-5d74a1678403 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160632 Sep 11 05:53:02.103632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1183/2140] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:03.049351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:03.051493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:03.057866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:03.058289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:03.058727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:03.059414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:03.060110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:03.060544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:03.089340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c324da5-18ff-432b-8b57-61ecfa645588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Sep 11 05:53:03.089915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 958/2141] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 05:53:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:53:03.129196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:03.129815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:03.136216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:03.136708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:03.137150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:03.138356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:03.138816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:03.139249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:03.273412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:03.282876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:03.284353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:03.285531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ad7574f-beb0-40b3-8049-fa39cd3ff5ee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160276 Sep 11 05:53:03.286083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1184/2142] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:04.101651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:53:04.103799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:04.110829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.111311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.111750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.112483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.112941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.113369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.309313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:04.310009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:04.316179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.316663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.317095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.317784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.318233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.318651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.403121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f8149e6-aeba-4198-8d7b-9270f7552d41 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action" status: 200 len: 76167 microversion: 2.1 time: 0.305054 Sep 11 05:53:04.404428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 959/2143] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 05:53:04 2022] POST /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699/action => generated 76167 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:53:04.411070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:04.411944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:04.419747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.420536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.421645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.422305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.422915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.423569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.464267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:53:04.470844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:04.480738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:04.482515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:04.483672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f607d30c-1d91-42c1-9ad6-3db8e1b5f363 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.178243 Sep 11 05:53:04.495068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1185/2144] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:04.545368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46e897aa-f623-4707-89e0-7b3aa8583948 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 204 len: 0 microversion: 2.1 time: 0.139310 Sep 11 05:53:04.545963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 960/2145] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:53:04 2022] DELETE /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:53:04.555105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:04.555924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:04.562192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.562622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.563061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.563754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:04.564250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:04.564679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:04.693803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:04.703009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68d5c1cc-8440-4e69-92f2-85d24bc4a9c2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151953 Sep 11 05:53:04.703583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1186/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:04 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:05.481053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca8d7fe0-d918-47cc-a83c-195e8f54fd96 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] Calling method '.version_select at 0x7f2c429e95e0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:05.486347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca8d7fe0-d918-47cc-a83c-195e8f54fd96 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [d4feb119-366a-47dc-bbf4-6c491f64609b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 05:53:05.509632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:05.510282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:05.517171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:05.517635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:05.518115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:05.518762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:05.519216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:05.519653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:05.650156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:05.659023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:05.660519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:05.661713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97eba277-2ac6-4eba-81bb-55c96e925962 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156183 Sep 11 05:53:05.662266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1187/2147] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:05.726168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:05.726778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:05.732835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:05.733321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:05.733755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:05.734440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:05.734893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:05.735318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:05.868427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:05.877563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-159bf9b4-df22-43e5-8046-dee612cf4535 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154976 Sep 11 05:53:05.878122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1188/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:06.493074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca8d7fe0-d918-47cc-a83c-195e8f54fd96 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] [d4feb119-366a-47dc-bbf4-6c491f64609b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59936. Sep 11 05:53:06.512489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca8d7fe0-d918-47cc-a83c-195e8f54fd96 tempest-TestVolumeBootPattern-533678925 tempest-TestVolumeBootPattern-533678925-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1753796652" status: 202 len: 0 microversion: 2.1 time: 1.035693 Sep 11 05:53:06.513483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 961/2149] 10.222.0.33 () {58 vars in 1263 bytes} [Sun Sep 11 05:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1753796652 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:53:06.568284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:06.568787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:06.571185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=56 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:06.576726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.577217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.577649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.578687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.579343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.579762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.605791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:53:06.686754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:06.687498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:06.690465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:06.692616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffccd6aa-11ab-4991-839a-5dbba0bab2a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 204 len: 0 microversion: 2.1 time: 0.127849 Sep 11 05:53:06.693249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1189/2150] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:53:06 2022] DELETE /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:53:06.694108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.694602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.695049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.695761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.697117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.697774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.703470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:06.704213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:06.710132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.710623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.711070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.711777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.712253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.712679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.735143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:06.900918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:06.906789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:06.910001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e41cba6-eef8-4a25-8383-8e33f221fc64 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.211516 Sep 11 05:53:06.910917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1190/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:06.915604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:06.916310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:06.922980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:06.924496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:06.925691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f12ad240-24c5-40ad-b1c2-11e105795c2c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.243125 Sep 11 05:53:06.926840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 962/2152] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:06.930456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.931234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.931679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:06.932447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:06.932877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:06.933305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.150592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:07.159457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4133881a-6c0e-4f8a-9c97-97494e03d6ee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.247278 Sep 11 05:53:07.160052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1191/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:06 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:07.582159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:07.583563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:07.590121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.591407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.592183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.592955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.593713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.594210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.620652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:53:07.708109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85c07420-0ec6-4829-98fe-70987bdf69d2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 204 len: 0 microversion: 2.1 time: 0.129433 Sep 11 05:53:07.708981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 963/2154] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:53:07 2022] DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:53:07.717892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:07.718517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:07.724739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.725223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.725670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.726365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.726822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.727250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.938566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:07.939307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:07.946620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.947416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.947854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:07.948606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:07.949236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:07.949664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:08.087609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.096855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58739019-7d38-4290-acbb-e1952294bf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.163765 Sep 11 05:53:08.097439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 964/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:08.118415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:08.119025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:08.125061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:08.125554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:08.125995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:08.126706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:08.127166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:08.127594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:08.215227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.224646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f3db600-b01b-44c0-8401-0b15357a2d3a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.510916 Sep 11 05:53:08.225636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1192/2156] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:08.230294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:08.230983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:08.236902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:08.237468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:08.237985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:08.238780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:08.239317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:08.239823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:08.277580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.286839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.288415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.289603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6852bb90-5331-4687-a7f2-39f8975e42bd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.175105 Sep 11 05:53:08.293582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 965/2157] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:08.449897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:08.458848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-324a798f-a01c-4503-b914-0858bc72ec59 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.231992 Sep 11 05:53:08.459348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1193/2158] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:09.121293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:09.122009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:09.131478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.132295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.132934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.133872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.134324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.134752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.250207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:09.251520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:09.258439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.259432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.260077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.261588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.262221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.263776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.293537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.306874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b97658b-47db-4257-9ddb-b4f401baf686 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.186536 Sep 11 05:53:09.317568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 966/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:09.322754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:09.323369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:09.329898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.330379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.330821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.331512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.331964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.332439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.461186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.470262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.471712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.472919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4cd47be5-d088-458f-92db-3af708816a42 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154293 Sep 11 05:53:09.473493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 967/2160] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:09.481941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:09.482766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:09.489136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.489841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.490534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.491508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:09.492064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:09.492568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:09.597436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.606449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0a1f9b5-522a-43be-848b-b82eeedeb86d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.360204 Sep 11 05:53:09.608306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1194/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:09.660510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:09.670842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef7d62f2-da69-4f6f-a1eb-baa3f33af213 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.192304 Sep 11 05:53:09.671426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 968/2162] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:10.342401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:10.343405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:10.358901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.360961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.362052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.367507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.368272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.369711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.498757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:10.500049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:10.511048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.511786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.513022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.513916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.514543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.515160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.538617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:10.547550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a6cd3a5-b34f-420d-90bf-52270bfcbc65 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.222368 Sep 11 05:53:10.548439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1195/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:10.633775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:10.634495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:10.641861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.642629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.643413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.644208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.645092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.645701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.756225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:10.766284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:10.767866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:10.769309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ff46664-66a5-44bc-9d99-d61f5fc7601f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.274695 Sep 11 05:53:10.783575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 969/2164] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:10.783575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:10.783575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:10.783575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.784099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.784099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.784099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:10.784099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:10.784458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:10.792849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:10.801989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfde6dec-fafe-494f-a653-fb42a6f3a8c3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.174063 Sep 11 05:53:10.802570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1196/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:11.026574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:11.035283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c49e8ad6-a62c-44eb-aa70-75e0dd9deece tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.264454 Sep 11 05:53:11.035851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 970/2166] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:11.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:11.571550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:11.578631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.579473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.580317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:11.581044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.581504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.582243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:11.738448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:11.746731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-306e8b73-5322-4422-86a9-9cd623c5d0c3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.179798 Sep 11 05:53:11.747426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1197/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:11.798457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:11.799091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:11.807031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.807618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.808143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:11.808882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.809482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.810007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:11.813552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:11.828348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:11.829140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:11.836775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.838033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.838526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:11.839288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:11.839747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:11.840215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:12.008199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:12.021743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501d55da-b60c-43d5-a395-f1a909162e7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.198082 Sep 11 05:53:12.022439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1198/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:12.062063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:12.062701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:12.068850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:12.069417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:12.069861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:12.070569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:12.071028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:12.071460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:12.202875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:12.214528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:12.219758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:12.222682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:12.223631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34c589d0-6e3c-4831-a7d3-4da7d2bf194b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.429432 Sep 11 05:53:12.230308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 971/2169] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:12.231484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf688c5b-a2c1-4876-847e-262ccf3642fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.176090 Sep 11 05:53:12.232068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1199/2170] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:12.776090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:12.776811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:12.794089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:12.794598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:12.795039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:12.795765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:12.796267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:12.796901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.020453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.030146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57ec038f-333c-4fc0-b4bc-393f8bc6348d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.259518 Sep 11 05:53:13.030723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 972/2171] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:13.046500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:13.047122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:13.053210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.053910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.054532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.056041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.056494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.056927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.188228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.196577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-361b97d1-428a-4574-bf0b-70c54c11b8da tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153830 Sep 11 05:53:13.197145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1200/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:13.252633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:13.253352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:13.253930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:13.254547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:13.260137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.260503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.260670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.260999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.261146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.261465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.261733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.262130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:13.262253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.262646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.262767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:13.263186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:13.440210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.450950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05344f9a-a9d1-41e6-96bc-c77ed549ab29 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.200689 Sep 11 05:53:13.451536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1201/2173] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:13.516959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.525476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.526913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:13.528690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12dcfdea-ab3b-427f-824a-768c6493434d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.279872 Sep 11 05:53:13.529259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 973/2174] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:14.054433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:14.055815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:14.066001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.066928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.067975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.071240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.072087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.072763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.223818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:14.225208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:14.233649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.234385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.235000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.235952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.236601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.237635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.250439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.269245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08be8dd0-e555-49c3-aae0-b5ed9bd699d2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.217585 Sep 11 05:53:14.270438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1202/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:14.394032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.407483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e74869fb-aca3-4322-842c-2656df68f759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.188195 Sep 11 05:53:14.408266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 974/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:14.474731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:14.475639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:14.481830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.482393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.482835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.483540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.484024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.484463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.554529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:14.555249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:14.563469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.563981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.564462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.565202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:14.565625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:14.566197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:14.637092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.647707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5421e4a-e24a-48a0-8448-010ea460cd07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.176890 Sep 11 05:53:14.648409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1203/2177] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:14.720419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.729864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.731496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:14.732902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68be5889-07cf-43e8-8c8e-01d6809700c4 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.183135 Sep 11 05:53:14.733496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 975/2178] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:15.298552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:15.299290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:15.306060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.306622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.307144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.307929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.308491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.308997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.431063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:15.431700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:15.438617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.439113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.439784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.440580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.441052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.441502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.456070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.467424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c06b8adf-4819-4d7a-850f-88d91823e6a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.173725 Sep 11 05:53:15.468341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1204/2179] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:15.592293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.600554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d560711-43e6-4f18-8e26-b60d93791ceb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.173582 Sep 11 05:53:15.601124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 976/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:15.672811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:15.673426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:15.679383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.679871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.680351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.681043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.681501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.681931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.758966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:15.759721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:15.765674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.766445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.766869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.767573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:15.768055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:15.768491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:15.813020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.821256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8661f854-6eb4-405e-976f-fcf0876ad8e4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152790 Sep 11 05:53:15.821825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1205/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:15.900823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.909580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.911009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:15.912191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b4d8506-2a62-47ee-b8c5-3f995a833cb3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157206 Sep 11 05:53:15.912753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 977/2182] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:16.492861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:16.493428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:16.499912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.500435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.500878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.501576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.502038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.502471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.623860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:16.624522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:16.629103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:16.630857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.631335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:16.631496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.631771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.632535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.633067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.633394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.639512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4333bc64-4361-4462-8932-80ec5dc76a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150567 Sep 11 05:53:16.640112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1206/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:16.764879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:16.773376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa0d1ae3-54a3-45c1-b56b-53210aa258f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153566 Sep 11 05:53:16.773941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 978/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:16.844268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:16.844899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:16.850836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.851322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.851762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.852483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.852943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.853370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.938530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:16.939141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:16.945397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.945878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.946316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.947018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:16.947469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:16.947893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:16.984708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:16.992959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4602fd6-b22e-4050-b80e-4df44a604c49 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152585 Sep 11 05:53:16.993694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1207/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:17.079218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:17.087793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:17.089268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:17.090975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ae79dc1-7422-4a77-8526-a14c68e43749 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156381 Sep 11 05:53:17.091687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 979/2186] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:17.663448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:17.664097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:17.671028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:17.671664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:17.672148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:17.672849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:17.673306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:17.673740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:17.797446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:17.798011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:17.799899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:17.804881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:17.805371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:17.805809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:17.806657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:17.806948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:17.807369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:17.808499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0f5bd1b-33ac-4b5f-a08e-38e980402f47 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148904 Sep 11 05:53:17.809670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1208/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:17.935031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:17.943216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5fcb288-b670-467b-8e58-b1d8da8aef83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149775 Sep 11 05:53:17.943785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 980/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:18.016878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:18.017500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:18.023355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.023842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.024318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.025011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.025471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.025900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.116684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:18.117578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:18.124711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.125199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.125638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.126341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.126813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.127223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.160645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:18.170007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15bf1cdd-fdf4-4a4d-a9f0-2694e61354af tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157080 Sep 11 05:53:18.170623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1209/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:18.476846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:18.486732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:18.488186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:18.489350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86a5d394-f345-45f9-9ea5-401a9f5db6e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.376571 Sep 11 05:53:18.489899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 981/2190] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:18.834225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:18.834917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:18.841982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.842464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.842900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.843591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.844067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.844492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.966814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:18.967422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:18.969401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:53:18.969535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f (ip 10.222.0.33) !!! Sep 11 05:53:18.973385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:18.975657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.976272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.976618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.977321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:18.977778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:18.978201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:18.984354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32986d96-34b0-41d5-91e6-cb0ddd7a86f5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154166 Sep 11 05:53:18.985256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1210/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:19.106221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:19.114524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-87938454-48d0-4bca-a99d-467c8b649d08 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152329 Sep 11 05:53:19.115089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 982/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:19.193439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:19.194145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:19.200888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:19.201421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:19.201863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:19.202554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:19.203009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:19.203436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:19.333726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:19.342209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7cb416c0-50b7-473f-b642-dac5484cbee7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152650 Sep 11 05:53:19.342779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1211/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:19 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:19.514829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:19.515383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:19.521652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:19.522135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:19.522568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:19.523257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:19.523717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:19.524186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:19.653381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:19.661882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:19.663318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:19.664514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e37a310f-81cd-46aa-a2ef-fd4a3dc67596 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153799 Sep 11 05:53:19.665072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 983/2194] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:20.008261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:20.008999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:20.016735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.017219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.017658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.018350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.018802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.019231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.138965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:20.139700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:20.146207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.146684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.147117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.147813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.148288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.148706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.162976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.172500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7599a02d-887c-4695-b657-c90e787aefe7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.168021 Sep 11 05:53:20.173097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1212/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:20.366144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:20.366885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:20.373952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.374435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.374867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.375558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.376018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.376467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.442218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.451089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b74cff0-63f0-41e7-b4a7-3f0bdbacc90c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.316794 Sep 11 05:53:20.453240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 984/2196] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:20.513803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.522299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5d0f3f9-869b-45a2-bde9-933634ee6070 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160715 Sep 11 05:53:20.522855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1213/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:20.690121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:20.690681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:20.696660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.697137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.697574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.698260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:20.698710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:20.699133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:20.830433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.838994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.840960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:20.842343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c287b98b-f801-47d0-9c0f-8549834182e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156328 Sep 11 05:53:20.842897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 985/2198] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:21.196848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:21.197456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:21.204823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.205300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.205732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.206414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.206862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.207283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.340804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:21.349109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-caa8dc52-8348-45f6-8221-a5061d31bca2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156071 Sep 11 05:53:21.349619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1214/2199] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:21.476025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:21.476669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:21.483892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.484402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.484843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.485563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.486022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.486446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.547422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:21.548329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:21.554464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.554966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.555410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.556149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.564037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.564037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.614852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:21.623389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2891aba-bf66-475b-88fb-fa2702517e9d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151098 Sep 11 05:53:21.623984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 986/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:21.687170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:21.695496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bda3b77d-d4bc-4530-8f4c-e1e3949d1bc5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153385 Sep 11 05:53:21.696075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1215/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:21.868172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:21.868726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:21.874768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.875256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.875696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:21.876497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:21.876958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:21.877385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.007848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.010035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:22.018619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.020110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.021345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2551f2e-7b99-4524-ae54-6d5a2967821f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157127 Sep 11 05:53:22.021935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 987/2202] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:22.373264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:22.373874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:22.380244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.380731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.381163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.381841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.382290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.382710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.515363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.523818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-291fc3af-d004-46ca-9f5c-f8dc9774c7b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155214 Sep 11 05:53:22.524415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1216/2203] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:22.646995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:22.647605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:22.654937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.655409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.655842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.656554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.657035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.657457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.719563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:22.720220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:22.726089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.726578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.727021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.727715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:22.728202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:22.728630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:22.785040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.793546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61c326c7-22ca-4163-8c23-bed262b23759 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150218 Sep 11 05:53:22.794448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 988/2204] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:22.857154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:22.865387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c65fb20-1d9d-42bd-bbe6-18c16a3807bd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150606 Sep 11 05:53:22.865952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1217/2205] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:23.048317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:23.048938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:23.054866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.055350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.055793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.056523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.056983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.057414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.186270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:23.194746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:23.196236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:23.197409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da255295-6d8f-4657-81d9-5500d22e35c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153063 Sep 11 05:53:23.197969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 989/2206] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:23.548328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:23.548998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:23.555325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.555815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.556279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.556966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.557419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.557841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.684956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:23.693517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-337a55ba-bd0d-4013-850d-ac2f8c05b223 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148960 Sep 11 05:53:23.694081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1218/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:23.817409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:23.818061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:23.824467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.825537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.825984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.826687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.827147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.827579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.889800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:23.890419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:23.896575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.897065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.897499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.898193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:23.898792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:23.899220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:23.958039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:23.966829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7db87f32-bf3b-48b7-900c-9d06ed01e5c1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153269 Sep 11 05:53:23.967396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 990/2208] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:24.031084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:24.039211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-005cbfee-fb6d-4b88-913d-a7df680bc44d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154239 Sep 11 05:53:24.039774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1219/2209] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:24.222929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:24.223464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:24.229474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.229958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:24.230401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:24.231615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.232104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:24.232533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:24.361531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:24.369960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:24.371419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:24.372840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfe8c465-d3fc-4248-b263-fb4ff013344f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153945 Sep 11 05:53:24.373405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 991/2210] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:24.717752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:24.718380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:24.724960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.725442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:24.725873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:24.726560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.727009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:24.727431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:24.855621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:24.864195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a058199a-8211-4337-98b2-3f8f82cba3b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150818 Sep 11 05:53:24.864760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1220/2211] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:24.990685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:24.991223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:24.997883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.998365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:24.998802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:24.999489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:24.999938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.000384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.063193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:25.063813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:25.069739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.070221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.070655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.071343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.071798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.072251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.135225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:25.144625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80886f6c-c09d-498e-844e-ca972c813609 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157813 Sep 11 05:53:25.145419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 992/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:25.205748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:25.213902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-022a5de9-4278-4e3a-b0b2-24abe6cbc641 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155406 Sep 11 05:53:25.214464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1221/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:25.397532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:25.398147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:25.404840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.405331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.405783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.406492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.406949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.407380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.537015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:25.546100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:25.547543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:25.548798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f42f17ad-039f-47a4-8fe9-2d499526692e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155162 Sep 11 05:53:25.549298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 993/2214] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:25.887952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:25.888600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:25.895247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.895728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.896186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:25.896872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:25.897323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:25.897747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.025703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.034655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51dbb0bb-fefa-42cd-898b-339ea51c5572 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150981 Sep 11 05:53:26.035208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1222/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:26.168009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:26.169571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:26.175947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.176451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.176885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.177577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.178026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.178444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.237073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:26.237681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:26.243760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.244283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.244731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.245427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.245885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.246327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.261447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:26.308099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.316515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef4afc47-1d4d-4b81-a2f9-abd6fba2d4ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152410 Sep 11 05:53:26.317085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 994/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:26.379583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.388054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce72ff1b-9ffd-4a5d-97be-bd9220493bac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154798 Sep 11 05:53:26.388622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1223/2217] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:26.574007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:26.575108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:26.580964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.581453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.581887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.582582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:26.583039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:26.583462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:26.712538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.721747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.723190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:26.724388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2dd8342f-3d99-4f0a-8620-4226aff22475 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154270 Sep 11 05:53:26.724947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 995/2218] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:27.058878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:27.059697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:27.066166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.066675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.067110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.067840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.068316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.068740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.195120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.203973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-073bf84e-8625-46c3-93a9-d30f1c4a2c1e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149084 Sep 11 05:53:27.204553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1224/2219] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:27.341017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:27.341659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:27.347977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.348494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.348933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.349633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.350090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.350516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.410690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:27.411333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:27.417190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.417672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.418111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.418809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.419263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.419693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.480763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.489069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-631d8536-b06c-43b8-b2c0-c1b51192a4e8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151932 Sep 11 05:53:27.489801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 996/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:27.549155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.557302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c124cfb6-029c-469e-aebc-da4166d64a71 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150483 Sep 11 05:53:27.557865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1225/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:27.750381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:27.750993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:27.756892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.757375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.757813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.758513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:27.758965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:27.759391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:27.890277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.899338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.900809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:27.901987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9872976e-d2da-4bd5-acdd-54fc8175d431 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155633 Sep 11 05:53:27.902641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 997/2222] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:28.227236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:28.227787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:28.234455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.234942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.235384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.236107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.236599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.237030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.513719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:28.514343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:28.521001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.521485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.521921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.522627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.523077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.523501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.608248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:28.616914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b03ac738-5a77-4712-886a-7959cfd0d378 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.393567 Sep 11 05:53:28.628469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1226/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:28.633347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:28.634519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:28.640353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.641101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.641536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.642228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.642678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.643097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.667045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:28.676383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c75e20dd-7b24-406b-9385-80918e350f1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166984 Sep 11 05:53:28.677526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 998/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:28.773280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:28.782336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9246b5f5-c540-4423-a636-f76b57662772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152928 Sep 11 05:53:28.782891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1227/2225] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:28.927770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:28.928406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:28.935061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.935544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.935987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:28.936707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:28.937334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:28.937579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.070636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.079779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.081294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.082464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d47cb24-d170-445b-956e-224657ff26b5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158624 Sep 11 05:53:29.083018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 999/2226] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:29.643542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:29.644230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:29.650708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.651192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.651631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.652351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.653449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.653966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.700856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:29.701600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:29.708184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.708745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.709272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.710041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.710576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.711079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.789382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.799194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a57c8063-228d-4e49-8115-e1647378595b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.159756 Sep 11 05:53:29.800127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1228/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:29.808522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:29.809613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:29.815817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.816339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.816890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.817605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:29.818055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:29.818476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:29.851372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.861512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3833c6ec-68a0-4344-b95e-3f503819dbc7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.164727 Sep 11 05:53:29.862095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1000/2228] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:29.945808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:29.954670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c731cfa-0dab-43a0-9ece-2e88b5c513a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152336 Sep 11 05:53:29.955240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1229/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:30.106950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:30.107533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:30.113433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.113916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.114357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.115048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.115502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.115928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.241305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:30.249884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:30.251335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:30.252542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0731502e-6943-47b6-bfc2-8a69ab8e8e55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.149915 Sep 11 05:53:30.253099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1001/2230] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:30.822666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:30.823286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:30.830156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.830640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.831076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.831767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.832327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.832752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.886570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:30.887492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:30.894404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.894892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.895325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.896043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.896495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.896922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.969635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:30.978237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba002819-7984-4763-9246-189722afd872 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.159403 Sep 11 05:53:30.978814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1230/2231] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:30.983898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:30.984577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:30.991324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.991810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.992273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:30.992963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:30.993416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:30.993837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:31.034852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:31.042988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7bbd1610-87db-4cac-b03c-061220ece385 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.160291 Sep 11 05:53:31.044075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1002/2232] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:31.123633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:31.131686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21ed068a-d48d-4618-81d3-283b17b622dd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151947 Sep 11 05:53:31.132274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1231/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:30 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:31.278841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:31.279438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:31.285266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:31.285743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:31.286175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:31.286858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:31.287306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:31.287728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:31.413997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:31.423071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:31.424510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:31.425668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ced1782-d016-469d-9602-5f1360afbea1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151232 Sep 11 05:53:31.426222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1003/2234] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:32.002609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:32.003229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:32.009691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.010178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.010621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.011315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.012407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.012848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.066697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:32.067334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:32.075277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.075806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.076290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.077009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.077471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.077912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.093654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:32.147336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.157260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fd8f43d-bcbc-4bf8-b978-41ff895cb72e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158498 Sep 11 05:53:32.157833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1232/2235] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:32.162335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:32.162948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:32.169208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.169702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.170146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.170966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.171434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.171866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.235443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.243750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc8d92e4-21ff-45cb-8765-af08237c6e96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.180928 Sep 11 05:53:32.244371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1004/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:32.304951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.313126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b770d7d8-b667-47ae-b4e0-a248171befa4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154350 Sep 11 05:53:32.313702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1233/2237] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:32.451343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:32.451874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:32.457768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.458248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.458684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.459378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:32.459833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:32.460293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:32.590400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.598903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.600367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:32.601569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fec177bd-c019-4632-af6a-1143bcd597ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154760 Sep 11 05:53:32.602120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1005/2238] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:33.180945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:33.181600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:33.188708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.189198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.189642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.190342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.190804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.191237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.267564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:33.267962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:33.274335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.274820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.275260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.275964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.276447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.276876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.318350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.327108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcc396ee-65a8-4fa4-9541-4b6b01641d25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150070 Sep 11 05:53:33.327688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1234/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:33.336327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:33.336969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:33.343684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.344209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.344650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.345351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.345817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.346234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.410810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.419828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c968a57-4a1b-446d-bc6f-10dd1d252c4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156717 Sep 11 05:53:33.420507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1006/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:33.478524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.487449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1bb2a5b-4d4c-4531-a025-e26bc25dd29f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154827 Sep 11 05:53:33.488104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1235/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:33.626348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:33.626881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:33.632815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.633296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.633737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.634422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:33.634880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:33.635304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:33.766282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.774807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.776280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:33.778026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d261682c-afe4-4cdf-ba1d-bf3d3d9d2cfe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155135 Sep 11 05:53:33.778677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1007/2242] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:34.350650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:34.351308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:34.353723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:34.359491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.359982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.360451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.361176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.361642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.362075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.443187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:34.443799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:34.450448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.450928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.451391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.452126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.452584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.453011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.493119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.502273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-941b0be5-495e-4c65-9e02-fda7781a2f7f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155363 Sep 11 05:53:34.502974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1236/2243] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:34.509915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:34.510696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:34.517706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.518287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.518793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.519488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.519941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.520417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.587971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.596994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07f182c5-74a9-4e41-8f64-2529c17c1710 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157711 Sep 11 05:53:34.597576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1008/2244] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:34.649922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.658887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8e77689-7e39-4fe8-a96a-616af3118ec6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152629 Sep 11 05:53:34.659449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1237/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:34.803001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:34.803529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:34.805377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:34.811511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.812014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.812456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.813150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:34.813602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:34.814022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:34.944512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.953561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.954988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:34.956179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de45c922-8c6c-4f4d-99a7-24197ca56498 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157201 Sep 11 05:53:34.956726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1009/2246] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:35.526506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:35.527115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:35.534171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.534648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.535217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.535949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.536473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.536915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.620299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:35.620906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:35.628154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.628638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.629073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.629770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.630216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.630633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.667038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:35.675575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4d0fc8a-8f37-4a58-ba6e-4584e279e47b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152873 Sep 11 05:53:35.676566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1238/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:35.681067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:35.681680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:35.687985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.688522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.688971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.689663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.690123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.690559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.767220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:35.775449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa61420d-999c-4727-aad3-63addd0822bf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.159089 Sep 11 05:53:35.776043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1010/2248] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:35.819918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:35.828818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02a57923-0246-4a01-8157-9adac64517f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151247 Sep 11 05:53:35.829708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1239/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:35.981861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:35.982396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:35.988272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.988779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.989217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:35.989910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:35.990365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:35.990791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.122934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:36.135747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:36.137679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:36.138905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b129750-e5b8-4738-b261-cd68532247f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161534 Sep 11 05:53:36.139466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1011/2250] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:36.700153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:36.700868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:36.707110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.707592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.708059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.708750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.709205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.709629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.712169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:36.798620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:36.799330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:36.806016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.806747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.807071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.807775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.808257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.808811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.841900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:36.851183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a18da2ed-9039-4789-b994-e12e5f941969 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155595 Sep 11 05:53:36.851766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1240/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:36.856245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:36.856856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:36.862798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.863287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.863720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.864444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:36.865020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:36.865449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:36.943386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:36.952704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37be2183-a078-44bc-a64a-6ccc1a7f1f57 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157772 Sep 11 05:53:36.953585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1012/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:36.993352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:37.001941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-722ad694-5b72-40e6-a93d-0d24d770c3a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149169 Sep 11 05:53:37.002508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1241/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:36 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:37.164392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:37.165109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:37.170975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.171457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.172032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:37.172745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.173197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.173619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:37.303065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:37.312306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:37.313738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:37.314890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-592e848c-7491-4c8a-ac25-e4ec55613b8d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154525 Sep 11 05:53:37.315438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1013/2254] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:37.874801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:37.875333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:37.881715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.882194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.882631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:37.883318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.883771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.884228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:37.976200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:37.976942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:37.984419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.984982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.985494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:37.986256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:37.986774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:37.987201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:38.015795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.025308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8ab0b3d-4b7c-4eff-9232-f88d4008bb09 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154634 Sep 11 05:53:38.026044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1242/2255] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:38.031033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:38.031620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:38.037558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:38.038051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:38.038543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:38.039285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:38.039739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:38.040386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:38.129306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.137659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b829cd5f-3616-4006-a833-52fabff53194 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.165263 Sep 11 05:53:38.138235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1014/2256] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:38.172397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.180657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e5251f5-d555-4abb-9e54-34f21719690e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153772 Sep 11 05:53:38.181225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1243/2257] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:38 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:38.342123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:38.342735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:38.348647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:38.349134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:38.349580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:38.350282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:38.350740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:38.351168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:38.478230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.486718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.488320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:38.489502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d4557044-722b-4a45-a96f-a41533d8516a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151995 Sep 11 05:53:38.490064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1015/2258] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:39.050044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:39.050654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:39.057083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.057515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.057952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.059476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.060050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.060479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.161443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:39.162047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:39.169380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.169896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.170340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.171044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.171496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.171916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.189017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.197593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecebb671-ae46-4cd4-bd70-a4daecec2dda tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151455 Sep 11 05:53:39.198170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1244/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:39.203023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:39.203630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:39.209515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.210005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.210578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.211377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.211820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.212289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.315585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.324073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4aa22881-aa60-4273-b303-499295a4de70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166359 Sep 11 05:53:39.325404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1016/2260] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:39.352584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.361606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22a3332a-ab1d-4066-9390-1b8ba2d14bb7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162450 Sep 11 05:53:39.362166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1245/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:39.514445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:39.515058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:39.521298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.521785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.522229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.522924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:39.523380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:39.523804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:39.651434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.660739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.662168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:39.663338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cfb8f873-9479-4769-8a68-6d3c1e3d9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153024 Sep 11 05:53:39.663897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1017/2262] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:40.221287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:40.221821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:40.228329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.228810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.229251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.229938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.230391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.230817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.348838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:40.349589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:40.356587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.357140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.362788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.365914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.366406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.367023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.367815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.372994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ecc6e5d-dd4f-4fec-a395-10c71cc28584 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155592 Sep 11 05:53:40.374123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1246/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:40.383667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:40.384593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:40.391829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.392609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.393276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.394327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.395010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.395730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.509243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.522206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c6af8bc-b597-4360-8458-5ac19b0edd5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.173728 Sep 11 05:53:40.523381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1018/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:40.530422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.539982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38c6d980-d688-4043-b32d-704c9cb5a2da tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159910 Sep 11 05:53:40.540974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1247/2265] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:40.689718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:40.690356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:40.696377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.696844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.697277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.697964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:40.698409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:40.698829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:40.830583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.839075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.841209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:40.842372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c4be182-7b86-4c6a-aa4d-bc62a8e444f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156655 Sep 11 05:53:40.842930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1019/2266] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:41.407368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:41.407982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:41.414547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.415031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.415460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.416184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.416635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.417057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.545466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:41.547497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:41.548228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:41.553702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1c6db8f-1617-471e-a2a2-b936ce665028 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150208 Sep 11 05:53:41.554268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1248/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:41.554853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.555414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.555866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.556670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.557136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.557569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.567304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:41.567918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:41.573794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.574882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.575321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.576029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.576533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.576963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.694794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:41.704114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a732a80-6c5b-4516-a6bf-ccda9c18d185 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.160840 Sep 11 05:53:41.704700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1020/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:41.709350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:41.717830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9de376cf-1a32-4d6b-9c2e-c88d350e1220 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154189 Sep 11 05:53:41.718386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1249/2269] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:41.868224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:41.868834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:41.875330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.875840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.876324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.877022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:41.877476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:41.877900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:41.881735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:42.011194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.019931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.021386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.022559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa1b9272-7eeb-4bed-9a92-843bd3d96bc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158438 Sep 11 05:53:42.023110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1021/2270] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:42.579404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:42.580029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:42.586522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.587001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.587436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.588156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.588611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.589068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.726679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:42.727383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:42.731667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.734783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.735527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.736553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.737390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.738055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.738494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.741277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27075e96-95ea-4262-b139-ade713b3ed89 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.165849 Sep 11 05:53:42.754431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1250/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:42.766161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:42.766787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:42.772608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.773101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.773546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.774240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:42.774703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:42.775126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:42.878869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.887607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed719c1d-b824-47d2-859d-f35b644c1f4d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.164755 Sep 11 05:53:42.888186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1022/2272] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:42.907373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:42.915593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31da39cf-07e1-433e-8f53-57b1d90c91a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153534 Sep 11 05:53:42.916183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1251/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:42 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:43.048722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:43.049252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:43.055118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.055598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.056058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.056744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.057204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.057631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.188375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:43.196993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:43.198437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:43.199864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a64ce97c-865b-49ff-b62b-e17c4c3fc7ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155116 Sep 11 05:53:43.200476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1023/2274] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:43.768911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:43.769559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:43.776274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.776694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.777658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.778387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.778838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.779262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.908809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:43.910714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:43.911340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:43.916985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46a70781-10d3-4eed-b1e7-c7e06b46dcc5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152135 Sep 11 05:53:43.917559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1252/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:43.918394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.919057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.919508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.920246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.920704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.921131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.939984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:43.940693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:43.946493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.946975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.947411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:43.948134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:43.948592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:43.949022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:44.050741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:44.059430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c19f5e75-0b4e-45fa-8886-7b3818dc9263 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152509 Sep 11 05:53:44.060048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1024/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:44.078071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:44.086527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-694f73ae-2ae4-4b34-85ff-e219b4f78fd1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150346 Sep 11 05:53:44.087100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1253/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:43 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:44.225481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:44.226089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:44.231983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:44.232498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:44.232942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:44.233635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:44.234092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:44.234523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:44.360179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:44.368791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:44.370238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:44.371532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cacb9230-4312-4e3c-9581-3ff88c0e2225 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.149983 Sep 11 05:53:44.372119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1025/2278] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:44.941353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:44.941969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:44.948335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:44.948816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:44.949252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:44.949936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:44.950388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:44.950809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.082634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.082965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:45.083598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:45.090755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.091231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.091604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c99f40e2-3bcf-4099-b1b1-5438af0612a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154085 Sep 11 05:53:45.091746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.092203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1254/2279] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:45.092371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.092881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.093358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.110377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:45.111105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:45.117984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.118510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.118954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.119658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.120338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.120807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.229679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.238054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a83e472-7894-4b56-83dc-eca5a086a35b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158925 Sep 11 05:53:45.238626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1026/2280] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:45.252772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.261196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e152996d-b146-46c2-b0cc-9d4dc05947e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154909 Sep 11 05:53:45.262300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1255/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:45 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:45.397211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:45.397744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:45.403733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.404255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.404696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.405383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:45.405836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:45.406259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:45.534371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.543345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.544845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:45.546015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f97c486d-713d-4f5b-b3d5-878df26b1064 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152819 Sep 11 05:53:45.546571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1027/2282] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:46.115314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:46.115981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:46.122717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.123197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.123629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.124345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.124792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.125217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.252301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.254480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:46.260958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:46.262002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:46.262194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e500dbc-0ff1-439d-988f-33b352224e2c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151217 Sep 11 05:53:46.262707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1256/2283] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:46.268635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.269119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.269556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.270247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.270701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.271130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.285166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:46.285798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:46.291617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.292138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.293193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.294210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.294674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.295105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.404970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.413451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d23c07e9-179d-40dc-9f6f-426716261503 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156239 Sep 11 05:53:46.414010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1028/2284] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:46.429262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.437954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d0ef5c8-1859-417f-8165-77347b8572df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156498 Sep 11 05:53:46.438519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1257/2285] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:46.571012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:46.571622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:46.578166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.578646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.579083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.579772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:46.580257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:46.580685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:46.716024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.724642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.726080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:46.727260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d224a4c2-8413-484a-b01a-48b047256e1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160201 Sep 11 05:53:46.727824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1029/2286] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:47.286453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:47.287004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:47.294006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.294483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.294915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.295596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.296074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.296499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.422012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.430237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c769ed22-aec1-4938-b40d-27b109f88400 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147717 Sep 11 05:53:47.430796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1258/2287] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:47 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:47.438741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:47.439378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:47.445868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.446343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.446781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.447457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.447905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.448350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.461492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:47.462106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:47.467920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.468440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.468879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.469569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.470022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.470447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.579570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.587642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2fc486c-de56-4f33-a13d-49cdefcb5cf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152745 Sep 11 05:53:47.588237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1030/2288] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:47.608533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.616653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a5f9044-dea6-422a-b23c-7821fb97476a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158912 Sep 11 05:53:47.623844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1259/2289] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:47.752938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:47.753582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:47.759591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.760208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.760599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.761226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:47.762320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:47.762755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:47.899432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.907885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.909334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:47.910490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-862b90ef-26f7-49f6-a3c6-0e5b5f8a68bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161463 Sep 11 05:53:47.911050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1031/2290] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:48.453808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:48.454420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:48.460755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.461231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.461662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.462344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.462792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.463211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.595836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:48.604016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-834f59d3-851a-4dac-93c9-025483b0ebdc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154029 Sep 11 05:53:48.604809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1260/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:48.611237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:48.611940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:48.618392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.618870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.619306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.620075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.620661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.621088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.640129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:48.640774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:48.646879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.647364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.647804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.648523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.648976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.649401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.757118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:48.766549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5102ddbe-7992-4bcb-9549-5b6be12d257b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158859 Sep 11 05:53:48.767345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1032/2292] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:48 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:48.785387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:48.794573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f21e80a5-e58a-4e96-adf1-db495dad299b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158128 Sep 11 05:53:48.795146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1261/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:48 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:48.935575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:48.936211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:48.942225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.942708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.943143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:48.943851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:48.944334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:48.944784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.075789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.084431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.085924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.087189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7af26ba6-28cb-4f8b-b48e-d163fb32ebbe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156071 Sep 11 05:53:49.087655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1033/2294] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:49.628491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:49.629111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:49.635515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.636024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.637016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.637745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.638200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.638627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.768421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.776674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2424de50-997d-4799-8ba1-ff4c9f402ce4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152167 Sep 11 05:53:49.777864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1262/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:49.790040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:49.790655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:49.797486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.797993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.798424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.799113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.799591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.800032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.817716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:49.818388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:49.824928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.825411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.825856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.826551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:49.827006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:49.827433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:49.938308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.946584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ba13da2-b01e-43dd-9b33-818de47f8d1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.160402 Sep 11 05:53:49.947153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1034/2296] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:49.959580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:49.968408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3165392a-38e5-4a48-b09b-1ecc2bb0937b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154524 Sep 11 05:53:49.968983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1263/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:50.112751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:50.113370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:50.119362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.119850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.120337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.121287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.121758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.122191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.252585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:50.261759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:50.263303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:50.264542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5c437c3f-12f0-4ef1-a910-cf27b674ee2a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155728 Sep 11 05:53:50.265102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1035/2298] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:50.800665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:50.801261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:50.807681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.808206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.809188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.809863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.810316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.810764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.948404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:50.956699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bf496e2-017c-46ea-bde2-3d85e74e7e63 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.160084 Sep 11 05:53:50.957274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1264/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:50.968976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:50.969599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:50.976666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.977158 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.977601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.978307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.978765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:50.979196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:50.991321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:50.991948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:50.999208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:50.999705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.000189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:51.000890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:51.001722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.001860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:51.122178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:51.130346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae7b6070-9eab-4dbd-909a-000e92aeb929 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.165248 Sep 11 05:53:51.131041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1036/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:51.131288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:51.140348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b90bc038-6820-4217-a1e1-0f24ca3fb12c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152770 Sep 11 05:53:51.141166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1265/2301] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:50 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:51.290355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:51.290961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:51.297533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:51.298402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.299175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:51.300447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:51.301283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.302065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:51.431987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:51.434822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:51.442562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:51.444068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:51.445178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5febf199-3d1b-4655-bfef-eaac587d7181 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158807 Sep 11 05:53:51.445733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1037/2302] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:51.981160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:51.981799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:51.988369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:51.988859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.989297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:51.989985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:51.990438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:51.990863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.127044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.135334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a39f3d9a-21bc-47c8-88c2-5b439f088232 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158703 Sep 11 05:53:52.135901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1266/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:51 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:52.155298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:52.155934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:52.162509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.162998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.163151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:52.163441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.163775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:52.164195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.164652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.165084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.170028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.170518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.170959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.171654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.172139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.172572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.302968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.310394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.312160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b2c43bf-5647-40ad-b27a-85cb5dead8a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161391 Sep 11 05:53:52.312741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1038/2304] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:52.318721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea684aba-f237-4449-97da-e5eb85cc147a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159571 Sep 11 05:53:52.319285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1267/2305] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:52 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:52.471915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:52.472475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:52.478305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.478788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.479225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.479910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:52.480649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:52.481112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:52.609998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.618444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.619885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:52.621114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12971bfb-e93c-4272-853c-097f69299d19 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153097 Sep 11 05:53:52.627439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1039/2306] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:53.159184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:53.159802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:53.166227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.166712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.167151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.168496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.168984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.169413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.295889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.304453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d62368e-903e-42fa-86ed-efa3e61d8910 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149002 Sep 11 05:53:53.305026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1268/2307] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:53.334965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:53.335792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:53.343960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:53.343960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:53.344200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.344200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.344200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.344558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.344880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.345339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.348358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.348844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.349275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.350258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.350751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.351178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.482864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.485168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.491190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c68b916-de51-4598-9510-ed4fedefa537 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153748 Sep 11 05:53:53.491762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1269/2308] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:53.493602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1141f7f6-c794-42eb-8521-e2e8b2b84cfb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.162468 Sep 11 05:53:53.494171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1040/2309] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:53.650556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:53.651094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:53.657617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.658104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.658542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.659233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:53.659684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:53.660138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:53.786784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.796604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.798043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:53.799205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efabc835-d590-4053-9423-9fb9bce32328 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152699 Sep 11 05:53:53.799800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1270/2310] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:54.328912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:54.329643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:54.335541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.336178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.336485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.337179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.337656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.338068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.465646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.473871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-169f2c33-8759-4820-bfbf-4b5f7fabc130 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149585 Sep 11 05:53:54.474443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1041/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:54.515763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:54.516655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:54.517861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:54.518481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:54.523076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.523559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.523991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.524270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.524710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.524821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.525162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.525278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.525588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.525869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.526329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.526761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.659319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.660739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.668246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cbee8afc-6c33-4c76-a30e-2295a82f7c90 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153692 Sep 11 05:53:54.668828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1042/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:54.669919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-454a356c-35ba-4279-a867-7412895db042 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158860 Sep 11 05:53:54.670548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1271/2313] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:54 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:54.824168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:54.824788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:54.830776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.831268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.831911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.832644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:54.833104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:54.833536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:54.962464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.971528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.972985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:54.974148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-095c7858-9412-4ff5-9226-1b478f9a4c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153968 Sep 11 05:53:54.974699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1043/2314] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:55.498518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:55.499163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:55.505148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.505627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.506054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.506732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.507184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.507605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.634241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:55.642964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97762f08-1cff-4a96-a0f9-73ea47c7fa2f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149693 Sep 11 05:53:55.643518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1272/2315] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:55.691321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:55.691855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:55.692973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:55.693589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:55.698315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.698806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.699253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.699491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.699955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.700099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.700437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.700566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.700867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.701152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:55.701613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:55.702041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:55.717252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:53:55.830935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:55.831687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:55.839197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05553238-b7da-4969-b774-9bca3020fe71 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151808 Sep 11 05:53:55.840431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1044/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:55.840752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-292b2a98-5bc3-4971-9652-570770634144 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150574 Sep 11 05:53:55.844115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1273/2317] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:55.999337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:55.999873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:56.005747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.006219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.006648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.007334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.007780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.008233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.140718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:56.149381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:56.150834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:56.152055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ddf616b8-0982-40f9-9552-5efe44d39492 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157269 Sep 11 05:53:56.153048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1045/2318] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:53:56.665653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:56.666299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:56.672962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.673437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.673866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.674548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.674996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.675417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.805246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:56.814169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97f5156e-350f-4725-8da6-1cde5cc924bf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152390 Sep 11 05:53:56.814740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1274/2319] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:56.862823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:56.863386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:56.863510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:56.863620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:56.869354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.869837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.870084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.870276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.870568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.871499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.871615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.871958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.872250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:56.872410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:56.872714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:56.873145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:57.002154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.002477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.010440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-808333c0-5bb3-4760-aa75-7fb34f0f0f03 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151506 Sep 11 05:53:57.010745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8be1925-4f8d-471b-8eb4-d5a06306e7f4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151370 Sep 11 05:53:57.011014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1046/2320] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:57.011485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1275/2321] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:57.178433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:57.179037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:57.185877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:57.186353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:57.186868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:57.187456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:57.187905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:57.188351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:57.316621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.325259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.326698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.327877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e5dff8a3-78fc-4f4a-9b39-3af7d8e8b624 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153320 Sep 11 05:53:57.328492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1047/2322] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:57.838783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:57.839401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:57.845860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:57.846347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:57.846790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:57.847485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:57.847947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:57.848406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:57.978538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:57.987343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b697b80-445b-4a6c-84e7-427bddcb09b9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152405 Sep 11 05:53:57.987918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1276/2323] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:57 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:58.034248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:58.034462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:58.034916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:58.035039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:58.040952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.041354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.041505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.041830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.041966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.042260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.043298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.043911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.044061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.044370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.044478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.044797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.182237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:58.182460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:58.190670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-621851d3-5a77-434a-be29-2e8343583061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160152 Sep 11 05:53:58.191070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-362a3cfe-7e98-4af8-9e03-c89680f22593 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.160363 Sep 11 05:53:58.191240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1048/2324] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:58 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:58.191779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1277/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:53:58.353756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:58.354374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:58.360990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.361477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.361905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.362669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:58.363049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:58.363476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:58.493420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:58.501924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:58.503380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:58.504582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7cc6535-b5e5-4063-ac92-b394046a904f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154814 Sep 11 05:53:58.505139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1049/2326] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:53:59.011868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:59.012557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:59.018896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.019380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.019826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.020547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.021061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.021493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.157172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.165490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f93364ee-4d7e-4727-a4c1-0b122a3bf22b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157823 Sep 11 05:53:59.166048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1278/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:59.213935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:59.214456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:59.214855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:59.215018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:59.221097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.221294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.221576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.221775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.222012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.222211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.222697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.222906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.223148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.223361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.223568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.223786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.353168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.356980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.362217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90d743aa-6d31-40ae-af89-25359c93d2d8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151667 Sep 11 05:53:59.362981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1279/2328] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:59.365171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16ae92cd-ff16-4b13-9baa-59c99bbe136d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155100 Sep 11 05:53:59.365730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1050/2329] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:53:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:53:59.530883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:53:59.531492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:53:59.537763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.538313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.538820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.539501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:53:59.539952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:53:59.540468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:53:59.668034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.676518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.678014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:53:59.679166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d59862c4-cf74-403c-af35-4fd084ba5a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152893 Sep 11 05:53:59.680046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1280/2330] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:53:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:00.190434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:00.191069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:00.196998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.197477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.197907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.198584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.199198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.199812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.324211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.332254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82442e29-cd43-4e30-b331-e6227ca65dab tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.145976 Sep 11 05:54:00.332814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1051/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:00.385880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:00.387404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:00.388917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:00.389535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:00.393874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.394369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.394811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.395514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.395755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.395979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.396269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.396437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.396707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.397416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.397872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.398299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.545919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.554381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb62d082-cf38-4de1-842d-821a08446f32 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.169873 Sep 11 05:54:00.554944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1052/2332] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:00.571076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.580155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72f6fbea-0ea2-42c9-9046-72e31ddaac17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.198243 Sep 11 05:54:00.580723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1281/2333] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:00.704962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:00.705432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:00.711177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.711658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.712123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.712818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:00.713269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:00.713687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:00.847909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.856883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.858333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:00.859551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2532173-b537-42cd-8101-c37593de7c8a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158593 Sep 11 05:54:00.860148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1053/2334] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:01.356636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:01.357287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:01.363238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.363729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.364182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.364865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.365316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.365737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.492829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:01.501018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc09987b-d6bc-46c8-ab32-0cce319157c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149131 Sep 11 05:54:01.501579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1282/2335] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:01 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:01.578468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:01.579103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:01.585592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.586072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.586513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.587200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.587686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.588138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.602803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:01.603418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:01.603628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:01.609709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.610126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.610562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.611251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.611703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.612161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.720161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:01.728296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a51b58da-5c37-4ed2-902a-15d3f5adf315 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154169 Sep 11 05:54:01.728870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1054/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:01 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:01.744895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:01.753220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98bc5bfd-8ec1-415f-9c82-4b0423af225c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154431 Sep 11 05:54:01.753783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1283/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:01.884569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:01.885108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:01.892076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.892549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.892980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:01.893690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:01.894141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:01.894561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.025034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.033654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.035099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.036301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b158e8ae-0125-4bdc-ba16-19243cf1bd17 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155716 Sep 11 05:54:02.037132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1055/2338] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:02.525810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:02.526435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:02.533579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.534066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.534506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.535199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.535659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.536201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.668723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.676867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7643ca1a-b940-4833-bb85-f2db261c990a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154973 Sep 11 05:54:02.677429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1284/2339] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:02.750543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:02.751172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:02.757597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.758074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.758507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.759186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.759643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.760087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.778752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:02.779291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:02.785105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.785583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.786021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.786701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:02.787149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:02.787571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:02.894847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.903589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9730d08a-d2db-4503-a7c5-f00c2cb04826 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156794 Sep 11 05:54:02.904226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1056/2340] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:02.925950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:02.934950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83dfba24-9c86-4d30-a6b8-14597da57098 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161007 Sep 11 05:54:02.935509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1285/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:03.063272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:03.063815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:03.069798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.070274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.070704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.071380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.071829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.072288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.201116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:03.209478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:03.210903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:03.212081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-72794fdc-947a-4bce-a7c5-e0480cc3c3c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153687 Sep 11 05:54:03.212639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1057/2342] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:03.701109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:03.701736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:03.704130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:03.711394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.711903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.712421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.713078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.713536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.713964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.845652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:03.854845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c124ecd-a442-490b-a8e8-d02f52bfcdd2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158636 Sep 11 05:54:03.856350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1286/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:03.927225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:03.927911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:03.934722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.935279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.935787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.936588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.937112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.937607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.958237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:03.958884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:03.965025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.965511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.965951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:03.966643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:03.967098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:03.967525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:04.072080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:04.081378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ca6dd77-4ad1-4061-a494-f40658eb1ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158475 Sep 11 05:54:04.081989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1058/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:03 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:04.103151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:04.111691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edeb6983-9c6c-479b-b73d-5bdc545b8a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157244 Sep 11 05:54:04.112281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1287/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:04.238004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:04.238484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:04.240445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:04.245996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:04.246706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:04.247146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:04.247845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:04.248320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:04.248743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:04.383559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:04.392646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:04.394111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:04.395289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a0a08e8-a8ac-4b12-bf19-9f4e870fb6eb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161611 Sep 11 05:54:04.395838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1059/2346] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:04.878729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:04.879355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:04.885962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:04.886451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:04.886895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:04.887593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:04.888086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:04.888521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.020668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.029613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-537b338e-4aea-4277-906c-a3bf3e706434 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154768 Sep 11 05:54:05.030179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1288/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:05.104547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:05.105994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:05.112449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.112929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.113358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.114043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.114490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.114913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.135345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:05.135965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:05.142863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.143354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.143793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.144518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.144978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.145412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.246146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.254591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5da064e-1baa-4e64-a733-c6e45d3d6921 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153837 Sep 11 05:54:05.255166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1060/2348] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:05.279022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.287183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cee0ed6-333f-4509-8b7e-45850f542e83 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155682 Sep 11 05:54:05.287733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1289/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:05.419783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:05.420424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:05.426489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.427010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.427482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.428211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:05.428672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:05.429155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:05.561293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.569970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.571542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:05.572733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad23c172-9a50-48c6-90fe-1d81f4db933f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156938 Sep 11 05:54:05.573291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1061/2350] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:06.053288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:06.053911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:06.061091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.061582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.062024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.062718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.063176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.063605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.066177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:06.195730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.204264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62509a44-4aa4-47a6-b93d-4dd097fa7f6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154750 Sep 11 05:54:06.204831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1290/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:06.278751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:06.279359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:06.285791 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.286205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.286635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.287312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.287759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.288210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.310864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:06.311472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:06.317311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.317789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.318223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.318912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.319361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.319788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.422563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.431447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d141b41-1199-440a-97a7-1849f04d58fd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157076 Sep 11 05:54:06.443975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1062/2352] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:06 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:06.452457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.460670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-086a98fa-2a2b-4394-ac93-a4a8a4f9901f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153816 Sep 11 05:54:06.461301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1291/2353] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:06.600346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:06.601017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:06.607830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.608561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.609008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.609738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:06.610268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:06.610735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:06.739455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.748720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.750155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:06.751325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f1b6a06-95ef-4b8d-8509-788ef959de35 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155006 Sep 11 05:54:06.751890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1063/2354] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:07.227488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:07.228172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:07.234810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.235294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.235740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.236460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.236917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.237344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.365952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.374952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bed71599-42c9-4b2a-b89a-93ff41ed82a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151201 Sep 11 05:54:07.375498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1292/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:07.454992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:07.455605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:07.461955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.462431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.462866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.463545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.464020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.464444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.485001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:07.485611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:07.491380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.491863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.492360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.493039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.493528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.493952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.598637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.607783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ebbde6e5-cae2-418d-92e7-fbda6ebc93c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156523 Sep 11 05:54:07.608620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1064/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:07 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:07.628368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.637156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bde96b0-9c74-4553-8500-d9311bf9dac5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155977 Sep 11 05:54:07.638039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1293/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:07.778214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:07.778855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:07.784750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.785239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.785687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.786384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:07.786848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:07.787278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:07.915163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.924571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.926017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:07.927201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-092e7a4e-e7c6-45b9-95e0-453b9c28a545 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153583 Sep 11 05:54:07.927760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1065/2358] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:08.398501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:08.399103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:08.406538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.406967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.407409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.408137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.408607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.409040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.536235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:08.545255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-838013c8-1646-4db0-a279-f7352a5c5904 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150538 Sep 11 05:54:08.545834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1294/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:08.633454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:08.634098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:08.641674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.642149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.642580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.643269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.643716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.644166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.661095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:08.661662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:08.667703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.668218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.668659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.669354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.669809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.670234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.779912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:08.788564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f920ca8-a2f7-491d-9b91-8b8277fec825 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.161624 Sep 11 05:54:08.790088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1066/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:08.810465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:08.818739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32149df5-ad8c-42d3-997e-64490d10f4c9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161571 Sep 11 05:54:08.819307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1295/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:08.952273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:08.952815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:08.958814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.959306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.959751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:08.960490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:08.960953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:08.961390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.094122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.102628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.104104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.106177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29e407c8-d78d-4d4b-bb3b-8eacfb9bcb22 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158045 Sep 11 05:54:09.106737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1067/2362] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:09.568845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:09.569457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:09.575775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.576290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.576722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.577403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.577853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.578274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.704358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.712441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97626ad7-afef-46fc-9490-9ce4edbe13e2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147506 Sep 11 05:54:09.712997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1296/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:09.810716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:09.811365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:09.817744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.818225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.818664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.819403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.819811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.820259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.843265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:09.843975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:09.849982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.850457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.850895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.851585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:09.852054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:09.852480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:09.952530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.961067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae2375a4-324a-41ef-aea0-6d29278e6f1b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154281 Sep 11 05:54:09.961829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1068/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:09.987031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:09.995194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c1fec76-5a1f-4b8e-a7f8-5afac716f072 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156566 Sep 11 05:54:09.995796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1297/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:10.131621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:10.132203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:10.138840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.139318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.139748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:10.140448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.140910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.141573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:10.284600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:10.293432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:10.295002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:10.296213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bdb19307-f417-4f88-93aa-0a411f1ce87f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.168595 Sep 11 05:54:10.296771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1069/2366] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:10.736856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:10.737496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:10.743942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.744449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.744882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:10.746333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.746988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.747417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:10.875257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:10.883447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c1b94ec-55bc-4d1b-bc04-3e032453f9a9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150432 Sep 11 05:54:10.884042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1298/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:10.985815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:10.986456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:10.992888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.993309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.993775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:10.994462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:10.994912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:10.995387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.021714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:11.022753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:11.032250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.033020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.033722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.034836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.035338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.035917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.143015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:11.151264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86b00931-22f1-4036-8b83-811d88b05850 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.169289 Sep 11 05:54:11.151989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1070/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:11.173179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:11.181232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b89db66c-2625-41d5-a2c6-b477b44e03fd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166581 Sep 11 05:54:11.181865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1299/2369] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:11.321665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:11.322283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:11.328632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.329109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.329545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.330223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.330673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.331093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.335130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:11.462110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:11.470812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:11.472405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:11.473567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fab52f4d-70fa-4ad4-aef8-3121faa143c9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155770 Sep 11 05:54:11.474115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1071/2370] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:11.907376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:11.908018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:11.914467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.914955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.915393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:11.916114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:11.916575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:11.917003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.048221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.056393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-395e6bcc-3aee-49c1-a0fa-46fb6a733cb3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152915 Sep 11 05:54:12.056894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1300/2371] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:12.174286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:12.174974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:12.181521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.182006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.182447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.183176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.183634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.184077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.205607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:12.206213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:12.212043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.212549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.212982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.213659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.214817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.215566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.313655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.321788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b6949f3-65f5-4aa1-8329-7bdc5d875b52 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151506 Sep 11 05:54:12.322359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1072/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:12.343818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.352022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f4c3b51-b96b-41a2-88cd-630e38c43ae8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150189 Sep 11 05:54:12.352576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1301/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:12.498756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:12.499364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:12.505282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.505768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.506211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.506907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:12.507368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:12.507825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:12.636906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.647538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.649034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:12.650224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a96f9d78-d5b9-4dd1-81b9-0147f9a53222 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155458 Sep 11 05:54:12.650787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1073/2374] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:13.080255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:13.080896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:13.087394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.087873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.088340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.089048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.089579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.089998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.219962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.228295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9506516-9591-4640-915f-b09eef7a9ef2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151836 Sep 11 05:54:13.228866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1302/2375] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:13.344775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:13.345326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:13.351714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.352238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.352678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.353369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.353824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.354248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.376955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:13.377577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:13.383384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.383869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.384343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.385036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.385492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.386591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.491330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.500336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d636dd7d-0a20-4455-8bc7-83b2a931a9e2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159358 Sep 11 05:54:13.500908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1074/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:13.531816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.540180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e781ce4c-7b4d-476d-882f-8a7a49ba416d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.167014 Sep 11 05:54:13.540747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1303/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:13.676180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:13.676694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:13.682549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.683116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.683695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.684438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:13.684892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:13.685315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:13.821565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.836566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.841444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:13.842635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e84d515b-03a5-4961-86d0-4788ecf4c80a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.170452 Sep 11 05:54:13.843201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1075/2378] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:14.251822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:14.252368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:14.259110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.259605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.260078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.260799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.261261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.261695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.399511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:14.409367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-811eb918-3b27-4a22-8959-13dd6537a2cc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.160751 Sep 11 05:54:14.409367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1304/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:14.523975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:14.524612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:14.531798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.532325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.532768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.533463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.533918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.534349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.563659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:14.564302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:14.570086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.570564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.571018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.571683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.572174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.572599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.669606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:14.678155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b7642b7-fe4b-4b59-8d46-03ab713f57db tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158022 Sep 11 05:54:14.678723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1076/2380] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:14.707306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:14.715881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35be5f2a-0c44-4259-b756-0046f9ade671 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156034 Sep 11 05:54:14.716468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1305/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:14.875584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:14.876221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:14.882076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.882556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.882995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:14.883681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:14.884193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:14.884619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.011686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.020571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.022022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.023191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-421d61a9-8ea3-4984-b9b6-56fe5cefc3d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151510 Sep 11 05:54:15.023748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1077/2382] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:15.433431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:15.433960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:15.440581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.441073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.441518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.442220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.442683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.443117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.573966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.576379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:15.583804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec227986-e515-49f6-8516-3151806c55a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154305 Sep 11 05:54:15.584393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1306/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:15.702765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:15.703325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:15.709654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.710133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.710569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.711256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.711709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.712161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.738574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:15.739185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:15.745196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.746321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.746758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.747565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:15.748044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:15.748473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:15.843162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.851379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc808d46-3399-42ab-8361-58c1134ef640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152606 Sep 11 05:54:15.852063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1078/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:15.883015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:15.891577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26519ff5-250c-405d-9913-4a0454aaa205 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156521 Sep 11 05:54:15.892160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1307/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:16.048667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:16.049209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:16.055151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.055634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.056111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.056810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.057265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.057744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.189638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:16.198322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:16.199846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:16.201044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5ea50b1-466b-49bc-a704-cda17956f80c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156423 Sep 11 05:54:16.201600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1079/2386] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:16.607262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:16.607884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:16.614474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.614961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.615401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.616126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.616586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.617015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.756863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:16.765114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7601f8e0-bfcb-4e90-9450-019577a142d6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.161832 Sep 11 05:54:16.765677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1308/2387] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:16.875276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:16.875904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:16.882282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.882768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.883199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.883883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.884360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.884784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.915037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:16.915808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:16.922865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.923354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.923789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:16.924509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:16.924961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:16.925416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:17.013967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.022608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d0dd34ef-1ea5-4269-896c-04825457db72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151672 Sep 11 05:54:17.023180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1080/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:17.057774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.065960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-374ddeb2-5944-424d-86e2-62be9b28c6d4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154773 Sep 11 05:54:17.066522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1309/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:17.226191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:17.226718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:17.232936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:17.233412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:17.233842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:17.234519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:17.234971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:17.235389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:17.362838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.372256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.373771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.374930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d201de97-2e8e-496d-aafe-b26dd88ff57e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152732 Sep 11 05:54:17.375483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1081/2390] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:17.789132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:17.789644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:17.796793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:17.797272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:17.797705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:17.798395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:17.798846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:17.799276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:17.926291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:17.934656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86b6063f-fd7f-438c-bceb-089da89b0aa9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149438 Sep 11 05:54:17.935219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1310/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:18.047229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:18.047766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:18.054124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.054601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.055036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.055714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.056195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.056619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.088694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:18.090097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:18.096065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.096586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.097026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.097754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.098207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.098635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.186595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:18.194841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d52a3b5-8227-47f6-b73a-aa4bde8b5a34 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151497 Sep 11 05:54:18.195470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1082/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:18.227274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:18.235452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c593fc5b-c863-43a0-ad83-e675ddf6ae85 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150501 Sep 11 05:54:18.236023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1311/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:18.399725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:18.400372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:18.406587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.407070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.407532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.408258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.408715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.409138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.546824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:18.556131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:18.558109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:18.559340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28e8e4fc-d4c1-45a7-b71a-8abd5bda3d56 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163522 Sep 11 05:54:18.559917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1083/2394] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:18.958471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:18.958988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:18.965956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.966452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.966898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:18.967602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:18.968085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:18.968522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.098059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.106365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b127d23-2a7f-4b68-9de5-687d5fd97ef8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151763 Sep 11 05:54:19.107503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1312/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:19.219670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:19.220253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:19.226708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.227191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.227632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.228357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.228818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.229244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.258669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:19.259281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:19.265427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.265911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.266609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.267301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.267755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.268215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.359411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.367718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b215fd16-6b2e-4a2b-b51a-e209aa68a727 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151979 Sep 11 05:54:19.368413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1084/2396] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:19 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:19.397103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.405572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0b2d1c1-c9b8-4233-b06a-5f60d3eb93db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150728 Sep 11 05:54:19.406138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1313/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:19.584984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:19.585593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:19.591441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.591944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.592420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.593107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:19.593569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:19.593993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:19.720167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.728767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.730836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:19.732185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-21c79bbb-70d0-42eb-978e-c05b54801594 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151083 Sep 11 05:54:19.732751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1085/2398] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:20.129999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:20.130657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:20.137938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.138422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.138866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.139559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.140040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.140468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.269805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.278636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4feafdd2-3994-4ef0-bc1d-d204bc288ae7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152518 Sep 11 05:54:20.279179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1314/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:20.391682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:20.392336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:20.398515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.398984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.399413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.400228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.400677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.401093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.429159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:20.429777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:20.435892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.436413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.436852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.437545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.437999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.438427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.538212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.546821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-462e6dfa-679b-45fb-b778-17c05c6666e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159284 Sep 11 05:54:20.547393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1086/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:20.571102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.579409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e11c59ed-be12-4dfc-a3bb-7e14cd513107 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154086 Sep 11 05:54:20.579972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1315/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:20.758462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:20.758998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:20.765162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.765652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.766351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.767057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:20.767514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:20.767941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:20.900316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.903200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:20.910648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.912149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:20.913318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7dbe940d-06fd-4abc-a6f2-9c7e8aee9b2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158938 Sep 11 05:54:20.913890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1087/2402] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:21.302241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:21.302859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:21.309870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.310355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.310791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.311480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.311936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.312392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.440246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:21.449112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31e99644-d436-47a2-8131-1a9b61565f8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150102 Sep 11 05:54:21.449674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1316/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:21.570774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:21.571380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:21.578643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.579122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.579553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.580260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.580716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.581136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.602656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:21.603280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:21.609204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.609699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.610140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.610840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.611306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.611738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.719195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:21.727654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8eb58ee-1ac1-47d0-ab01-3cea74494c07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160979 Sep 11 05:54:21.728262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1088/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:21.749613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:21.757951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9887a86-e5b8-4d99-b990-e6a896e53270 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.159191 Sep 11 05:54:21.758516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1317/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:21.938964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:21.939581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:21.945626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.946140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.946574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:21.947256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:21.947710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:21.948198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.075959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.084527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.085971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.087129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-935db851-f961-4208-bd04-492c2df2e4a0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152075 Sep 11 05:54:22.087689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1089/2406] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:22.472858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:22.473480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:22.480605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.481091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.481529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.482245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.482702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.483128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.610518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.618686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-237fbd61-86cc-4509-b536-526c9a908134 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149674 Sep 11 05:54:22.619257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1318/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:22.751460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:22.752121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:22.758345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.758823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.759256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.759944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.760416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.761037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.781973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:22.782659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:22.788474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.788961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.789398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.790090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:22.790541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:22.790962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:22.892429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.901720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96ad2898-bcf4-42d7-a9cb-eaf29dfe79cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153603 Sep 11 05:54:22.903842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1090/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:22.928399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:22.937300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f373796b-0cb7-4092-9c5d-eb7f7fd571b5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.159127 Sep 11 05:54:22.937859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1319/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:23.112737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:23.113352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:23.119251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.119738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.120213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.121006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.121469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.121900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.462016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:23.471259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:23.472761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:23.473929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15aec0ee-c937-439b-9f08-5e5fce68e7d5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.365109 Sep 11 05:54:23.474489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1091/2410] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:23.643238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:23.643881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:23.650405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.650888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.651356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.652058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.652512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.652934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.779225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:23.787335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd9bbc3b-5c37-43c5-a8ef-2f406f60f70e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148317 Sep 11 05:54:23.787901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1320/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:23.925488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:23.926133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:23.932656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.933101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.933544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.934238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.934699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.935130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.961197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:23.962036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:23.970324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.970814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.971246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:23.972138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:23.972591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:23.973013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:24.081568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.090737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68e414e5-986a-479e-90fb-58d6fa4dc6a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.169021 Sep 11 05:54:24.091402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1092/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:24.110819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.118940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d649e204-e238-447b-9ed8-2c0d0c5e508f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161709 Sep 11 05:54:24.119495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1321/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:24.499739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:24.500369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:24.506228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:24.506732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:24.507166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:24.507849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:24.508336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:24.508757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:24.640295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.649196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.650631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.652480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bb17036-17e1-43f1-b37f-44b0ad14a0a2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156791 Sep 11 05:54:24.653037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1093/2414] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:24.811076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:24.811699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:24.818108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:24.818584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:24.819017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:24.819699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:24.820184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:24.820610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:24.945669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:24.954022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eba8867c-0d00-4ba2-8f8d-9ab46e039d30 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147503 Sep 11 05:54:24.954587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1322/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:25.113709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:25.114428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:25.121147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.121637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.122078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.122778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.123240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.123670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.142429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:25.143129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:25.149129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.149686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.150216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.150973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.152261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.152760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.168490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:25.253874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:25.262285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d8d25a3-6fff-4efe-999a-913f096a5f9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152542 Sep 11 05:54:25.262866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1094/2416] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:25.283205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:25.291425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f161f828-2788-43a0-9460-8bfa67a0fa17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153171 Sep 11 05:54:25.292625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1323/2417] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:25.677990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:25.678610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:25.684653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.685138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.685576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.686266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.686721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.687205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.817953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:25.827042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:25.828509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:25.829675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7c7952b-582b-48c6-ab16-6bd6bba3a980 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155643 Sep 11 05:54:25.830232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1095/2418] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:25.977271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:25.977878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:25.985075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.985549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.985977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:25.986657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:25.987105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:25.987524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.117375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:26.126405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec838189-99aa-4522-b34f-d90673521a2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152939 Sep 11 05:54:26.127120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1324/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:26.285792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:26.286409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:26.292962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.293445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.293885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.294578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.295032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.295456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.314612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:26.315224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:26.321232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.321651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.322085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.322769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.323828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.324509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.424556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:26.433009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f998ba89-5e52-4fdb-84fc-4a8926dfae8f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150956 Sep 11 05:54:26.433676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1096/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:26.452327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:26.460556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89fa948d-5a80-4250-8771-7098303ad5de tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149810 Sep 11 05:54:26.461116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1325/2421] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:26.855142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:26.855750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:26.861680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.862163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.862601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.863288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:26.863741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:26.864210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:26.994557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.003440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.004887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.006040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f4e788e9-5b9c-4938-8fa7-495844f116df tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154940 Sep 11 05:54:27.006592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1097/2422] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:27.150117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:27.150733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:27.157696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.158182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.158618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.159310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.159767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.160230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.292542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.300716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf93ac83-4c46-4f04-bd19-e17edb4d119a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154406 Sep 11 05:54:27.301294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1326/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:27.455812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:27.456374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:27.462806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.463283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.464360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.465061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.465492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.465915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.484661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:27.485269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:27.491151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.491629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.492093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.492780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:27.493226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:27.493647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:27.596576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.605658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4818bdf-19ea-425b-b69c-60339fd305b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153402 Sep 11 05:54:27.606017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1098/2424] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:27.625664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:27.633821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22570bce-45d0-4fe3-b91a-6fd08fa9a3f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152989 Sep 11 05:54:27.634385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1327/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:28.032715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:28.033332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:28.039216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.039708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.040176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.040868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.041329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.041760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.169635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.178156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.179716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.180913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85f6b153-e486-4c10-9407-38b68b1029bc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152190 Sep 11 05:54:28.181479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1099/2426] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:28.324355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:28.325007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:28.331081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.331571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.332034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.332737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.333194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.333627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.462773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.471046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07f7500b-8aff-4452-b090-11c2ec2563d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151178 Sep 11 05:54:28.471607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1328/2427] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:28.628304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:28.628924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:28.635977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.636605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.637047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.637744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.638203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.638629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.657824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:28.658434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:28.664285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.664707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.665139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.665826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:28.666274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:28.667074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:28.778893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.787016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25057c62-bed0-4576-9a33-be5dc0b122a9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162665 Sep 11 05:54:28.787709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1100/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:28.811603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:28.820015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2788fda-ba71-4c76-81f3-101a791332a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166146 Sep 11 05:54:28.820596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1329/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:29.207719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:29.208375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:29.214981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.215456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.215893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.216600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.217051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.217469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.348322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.357146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.358601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.359777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a99aa78b-51bb-4d47-b914-b450a9ae734d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155990 Sep 11 05:54:29.360366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1101/2430] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:29.496076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:29.496615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:29.502544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.503025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.503456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.504170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.504626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.505047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.633708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.643255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db60a51a-0f2e-4cb8-bf33-159c8bca14a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151413 Sep 11 05:54:29.644111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1330/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:29.813495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:29.814098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:29.820542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.821026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.821457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.822138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.822586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.823849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.842820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:29.843551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:29.849951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.850517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.851002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.851694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:29.852181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:29.852604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:29.956062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.964649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-094b06e7-ada3-4de9-a867-aa71d4f12302 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154868 Sep 11 05:54:29.965234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1102/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:29.984865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:29.992948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3abbc2e8-e0a0-4066-a703-b4efbdae5e6b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154124 Sep 11 05:54:29.993502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1331/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:30.384834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:30.385503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:30.392130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.392612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.393046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:30.393732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.394187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.394607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:30.521898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:30.530979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:30.532460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:30.533678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-04a3ec86-2444-4ff6-9904-f44695e68354 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153090 Sep 11 05:54:30.534223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1103/2434] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:54:30.666697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:30.667447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:30.673144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.673619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.674053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:30.674734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.675183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.675602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:30.802467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:30.811183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3610500f-77cc-4159-8382-66c6d44c0f12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148353 Sep 11 05:54:30.811745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1332/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:30.988138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:30.988699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:30.994660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.995151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.995591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:30.996314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:30.996779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:30.997207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.012303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:31.017897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:31.018515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:31.024547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.025031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.025471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.026971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.027463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.027888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.125925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.134026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9aadfd91-6140-49b5-9a98-6475b5a7f060 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149879 Sep 11 05:54:31.134590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1104/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:30 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:31.159063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.167463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c93e1b9-d8ec-4059-8546-34ca7085bc8d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153631 Sep 11 05:54:31.168047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1333/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:31.561453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:31.562060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:31.568350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.568826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.569260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.569938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.570385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.570803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.701031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.709395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.710822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.711976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-121cb2c2-b023-4bf6-8eff-dfaea7ad1a1d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155334 Sep 11 05:54:31.712556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1105/2438] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:31.834446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:31.835068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:31.841629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.842111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.842548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.843236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:31.843692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:31.844147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:31.969146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:31.977492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a2e58bf-d72e-4206-8945-b8619aeb386c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.146856 Sep 11 05:54:31.978053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1334/2439] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:32.158316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:32.159019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:32.165264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.165831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.166267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.167005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.167497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.167974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.191139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:32.191734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:32.198749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.199326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.200039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.200761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.201221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.201652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.298090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:32.306245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ff97ef7-2925-41db-a441-a3a40ea6f246 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151766 Sep 11 05:54:32.306818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1106/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:32.331320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:32.340192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-461899dc-ba18-4111-8896-accb0978bfd7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153402 Sep 11 05:54:32.340752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1335/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:32.738237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:32.738753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:32.746072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.746560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.746998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.747682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:32.748160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:32.748583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:32.883769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:32.894021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:32.895480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:32.896756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09d32ced-0a47-4a1c-b730-050e6c2e96c1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162541 Sep 11 05:54:32.897389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1107/2442] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:33.002405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:33.002974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:33.004914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:33.010419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.010909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.011467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.012208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.012666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.013098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.330149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:33.330764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:33.336649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.337123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.337555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.338244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.338940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.339510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.377663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:33.386688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce481f37-ed43-4114-a2ba-1dca99719479 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.388299 Sep 11 05:54:33.387274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1336/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:33.392086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:33.392693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:33.398647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.399142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.399587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.400317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.400780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.401280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.470975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:33.479762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80458d3d-ccac-4cd6-9d51-506320dec120 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153018 Sep 11 05:54:33.480362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1108/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:33.530772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:33.539046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d51fd47-69c0-4803-a779-82d2bd365ef3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150739 Sep 11 05:54:33.539646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1337/2445] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:33.922237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:33.922780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:33.925104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:33.930771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.931257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.931702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:33.932546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:33.933185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:33.933622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.064768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.073940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.075396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.076610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e7d045f-696c-4505-8f72-1fbbbc85b3f0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158432 Sep 11 05:54:34.077173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1109/2446] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:54:34.410362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:34.410979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:34.417993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.418475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.418914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.419601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.420088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.420519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.502886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:34.503492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:34.509404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.509885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.510320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.511078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.511527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.511949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.555480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.565701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29f875c8-1c30-4ec0-8fc8-3f243791a72f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.159043 Sep 11 05:54:34.576822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1338/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:34.576822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:34.576822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:34.577793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.578289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.578730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.579428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:34.579880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:34.580503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:34.653275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.663968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fddd0c13-6884-440c-a2b8-0d44466f5735 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.165028 Sep 11 05:54:34.668030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1110/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:34.725979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:34.734268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6095469-523f-4591-a0b1-cd1346bfdafd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.167059 Sep 11 05:54:34.734830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1339/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:35.102258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:35.102889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:35.110015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.110497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.110935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.111623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.112102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.112530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.241147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.249756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.251187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.252375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-001f4310-fa57-469f-b668-ca17cf3c1e64 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154006 Sep 11 05:54:35.252927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1111/2450] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:35.589648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:35.590276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:35.596800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.597285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.597721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.598406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.598868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.599295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.603221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:35.686968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:35.688267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:35.694451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.694947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.695446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.696190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.696661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.697090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.734692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.743105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9064cb48-792f-4efa-ad4d-74ae2b6f4027 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157437 Sep 11 05:54:35.743717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1340/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:35.756836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:35.757724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:35.764738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.765232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.766138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.766636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:35.767119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:35.767549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:35.838164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.847063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-701e7aac-ad97-43a7-aeca-5662fc3389d7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.163735 Sep 11 05:54:35.847568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1112/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:35.902559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:35.910828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4f91ce2-98e7-4af5-b29b-3ea2177f301d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158074 Sep 11 05:54:35.911393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1341/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:36.279283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:36.279886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:36.286216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.286696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.287127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.287808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.288295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.288713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.415568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:36.424947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:36.426426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:36.427594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e7e490a-ea9a-47f6-bd5f-af23ca97dac9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153116 Sep 11 05:54:36.428181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1113/2454] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:36.767808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:36.768452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:36.777799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.778327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.778772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.779481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.780019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.780456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.872237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:36.872965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:36.878986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.879558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.880089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.880726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.881186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.881611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.907758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:36.919356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3f594d9-453b-4b0e-90e9-5bcdc037ef29 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155705 Sep 11 05:54:36.919940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1342/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:36.935222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:36.935845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:36.941801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.942351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.942863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:36.943609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:36.944193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:36.944689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:37.020627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:37.029496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d34f5155-ecc0-4a9e-a277-6e5a4b258402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.163374 Sep 11 05:54:37.030069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1114/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:36 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:37.078846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:37.087232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90b94acc-2d5a-4a92-8943-55b012ff3829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156440 Sep 11 05:54:37.088619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1343/2457] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:37.452542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:37.453191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:37.459903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:37.460413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:37.460861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:37.461554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:37.462014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:37.462441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:37.591852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:37.600486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:37.601909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:37.603059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80b18f2c-d927-4d37-9e00-64597efb20f7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154449 Sep 11 05:54:37.603614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1115/2458] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:37.942536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:37.943157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:37.949742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:37.950235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:37.950706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:37.951407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:37.951868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:37.952330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.052454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:38.053286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:38.059370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.059858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.060333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.061028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.061485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.061912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.079504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.087632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8051f3bc-e4ee-4ec4-99f8-656b551ec03e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148982 Sep 11 05:54:38.088217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1344/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:38.111301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:38.111917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:38.117767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.118252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.118687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.119386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.119839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.120297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.191172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.200120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a134bfe-e0ee-4956-af79-a3e95075abcc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151323 Sep 11 05:54:38.200942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1116/2460] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:38 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:38.252351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.260641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ee43a46-2cb7-453b-9ea0-983a6b1e731c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153239 Sep 11 05:54:38.261781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1345/2461] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:38.629746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:38.630351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:38.637667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.638147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.638583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.639266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:38.639720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:38.640180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:38.778235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.787978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.790655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:38.791914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b01d94c-3704-48cf-ba5f-4d1b21f53b1c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.166110 Sep 11 05:54:38.793484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1117/2462] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:39.111326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:39.111936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:39.118324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.118801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.119233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.119913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.121200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.121630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.222933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:39.223544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:39.229484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.230466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.230909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.231606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.232089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.232518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.248751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.256926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6f1b53c-ba85-4d72-b843-e071bab67108 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149434 Sep 11 05:54:39.257490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1346/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:39.285432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:39.286162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:39.293157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.293792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.294229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.294937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.295390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.295814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.362671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.370884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e427bea6-ff5f-409e-b776-65816f36d7d1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151778 Sep 11 05:54:39.371455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1118/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:39.426804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.435033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f73435e0-58d8-46d1-b12f-52fdb6ff9015 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153559 Sep 11 05:54:39.435600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1347/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:39.818405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:39.819015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:39.826125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.826602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.827037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.827719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:39.828204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:39.828630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:39.969998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.978574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.980548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:39.981861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-960e84fe-7f63-4441-bcde-9eab874d4455 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.167442 Sep 11 05:54:39.982422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1119/2466] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:40.280960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:40.281597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:40.288026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.288500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.288933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.289613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.290063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.290482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.393996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:40.394610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:40.400823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.401309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.402364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.403074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.403526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.403952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.420336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:40.428585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f6693fe-ccb1-4fca-b0b4-157b5fafe3aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152154 Sep 11 05:54:40.429159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1348/2467] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:40.458084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:40.458694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:40.465664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.466172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.466606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.467296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:40.467748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:40.468203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:40.536861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:40.546312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ad34b96-2d93-461a-8ffc-cf68bdc29b61 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156404 Sep 11 05:54:40.546912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1120/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:40.600231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:40.608592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1f31ecc-f902-4082-a700-6594945fddc3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154292 Sep 11 05:54:40.609155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1349/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:41.006994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:41.007611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:41.014639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.015126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.015566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.016541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.017002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.017431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.021298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:41.150188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.158999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.160447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.161601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad84a3d3-41ac-4f2c-a4d9-52d73d7c64c2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158608 Sep 11 05:54:41.162160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1121/2470] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:41.452362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:41.452890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:41.459275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.459763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.460238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.460926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.461381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.461815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.569378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:41.570006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:41.576077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.576567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.577009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.577716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.578176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.578604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.593352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.601763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3f1aca6-d04a-4ca8-aed7-e82d973657ea tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153348 Sep 11 05:54:41.602336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1350/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:41.632232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:41.632849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:41.639156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.639646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.640116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.640815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:41.641534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:41.641977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:41.707287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.716237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-236dfaa0-9c02-4912-9af1-663326c7261f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150761 Sep 11 05:54:41.716882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1122/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:41.773141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:41.781932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a21a9f50-4b68-4c7e-8220-f079b2091932 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153733 Sep 11 05:54:41.782498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1351/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:42.187098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:42.187711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:42.194247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.194737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.195179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.195878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.196380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.196815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.334669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.343241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.344728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.345898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c4003b14-73c4-4bb1-831d-1abb66a535ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162704 Sep 11 05:54:42.346466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1123/2474] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:42.625546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:42.626164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:42.632820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.633300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.633734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.634414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.634862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.635314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.739828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:42.740445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:42.747344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.747831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.748454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.749151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.749598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.750019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.775608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.784667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe1c9e7f-2a07-4984-b1ea-cb1741da73d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.162944 Sep 11 05:54:42.785249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1352/2475] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:42.805680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:42.806295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:42.813477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.813967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.814730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.815083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:42.815533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:42.815984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:42.884548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.893466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4f0a6bc-623a-4eb1-9b87-35aa93dc42be tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157485 Sep 11 05:54:42.894110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1124/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:42 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:42.946120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:42.954490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8416e61-b3d9-45d5-b3a1-f85281bd6869 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152713 Sep 11 05:54:42.955055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1353/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:43.370811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:43.371419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:43.377821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.378303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.378741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.379427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.379881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.380332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.508725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:43.518284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:43.519711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:43.520892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-270ead80-fb14-4e13-a501-620a6b8a895c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154170 Sep 11 05:54:43.521446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1125/2478] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:43.809536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:43.810159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:43.816682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.817170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.817618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.818309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.818767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.819197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.917780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:43.918576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:43.924600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.925095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.925539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.926246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.926714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.927146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.946152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:43.954781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8160525f-e46e-46a6-82eb-c85a1078e332 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149095 Sep 11 05:54:43.955362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1354/2479] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:43.977542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:43.978160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:43.984679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.985172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.985612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:43.986311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:43.986770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:43.987420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:44.061575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:44.069776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9828d3b0-b13a-4c3d-8c13-10ab86ed0176 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156651 Sep 11 05:54:44.070262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1126/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:43 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:44.134068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:44.134068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-080ef80f-3b0b-4315-b6aa-c3427285c13f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158563 Sep 11 05:54:44.134068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1355/2481] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:44.546843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:44.547452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:44.554567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:44.555048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:44.555485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:44.556204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:44.556658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:44.557078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:44.684949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:44.693453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:44.694914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:44.696110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8bd3626f-d4f4-4da4-b514-fcc7a357551e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153142 Sep 11 05:54:44.696668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1127/2482] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:45.147652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:45.149905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:45.157352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.157998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.158545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.159362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.159933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.160492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.217920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:45.219148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:45.225404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.226129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.226573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.227266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.227720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.228174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.298948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.301149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:45.308945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7d6636c-934b-4946-8c09-f4e1ff7668f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.334973 Sep 11 05:54:45.309726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1356/2483] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:45.314459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:45.315035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:45.321156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.321660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.322306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.323004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.323521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.324128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.360797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.369839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-905b3472-7af2-4116-aa1c-a75b2dded6cc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.280484 Sep 11 05:54:45.370454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1128/2484] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:45 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:45.456245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.464986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-583ea7f8-b4b1-451e-b3e6-2d1ba2f3eb02 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154497 Sep 11 05:54:45.465554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1357/2485] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:45.721407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:45.722042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:45.728423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.728899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.729333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.730561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:45.731002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:45.731420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:45.861258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.871211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.872925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:45.874089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aaae50b4-153d-4fa0-86da-4084feb97adb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156665 Sep 11 05:54:45.874649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1129/2486] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:46.332367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:46.332986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:46.339807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.340331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.340778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.341470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.341924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.342353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.393226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:46.393966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:46.399794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.400305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.400801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.402231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.403046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.403497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.471656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:46.480228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afb31127-59ae-4fc8-a659-5691dbdf784a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151363 Sep 11 05:54:46.480590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1358/2487] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:46.487382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:46.488018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:46.493966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.494460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.494898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.495929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.496403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.496833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.532893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:46.542643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08011213-3390-45c8-a169-d31d0a318d31 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152886 Sep 11 05:54:46.543233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1130/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:46.628246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:46.636423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66223c21-64b6-450c-9c2e-bbf43003c1ba tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152604 Sep 11 05:54:46.636987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1359/2489] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:46.899637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:46.900280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:46.907248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.907723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.908200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:46.908881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:46.909330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:46.909753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.041114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.049854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.051284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.052467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed740127-2f98-4949-b38e-aafa63194dcc tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156770 Sep 11 05:54:47.053015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1131/2490] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:47.503006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:47.503624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:47.510049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.510565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.511129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.511817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.512308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.512736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.566527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:47.567149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:47.573059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.573622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.574108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.574849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.575305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.575729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.644946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.653866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-166091e8-b206-4da6-bebf-986ff726a042 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154625 Sep 11 05:54:47.655220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1360/2491] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:47 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:47.660561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:47.662532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:47.669494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.669985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.670446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.671152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:47.671610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:47.672057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:47.707983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.717272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3bc1594d-1e06-42b6-ba52-720caba5ceae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154600 Sep 11 05:54:47.717855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1132/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:47.800792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:47.809979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-189af89c-0fd9-434f-b0ea-4503f7398b56 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153024 Sep 11 05:54:47.810560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1361/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:48.078277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:48.078923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:48.085324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.085814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.086257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.086958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.087412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.087843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.221213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.229779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.231221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.232421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-055f0b2a-5bc5-4959-9dea-63fa3693d0fa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158079 Sep 11 05:54:48.232983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1133/2494] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:48.678706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:48.679265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:48.686074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.686559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.686993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.687695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.688583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.689144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.740813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:48.741424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:48.747462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.747947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.748423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.749118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.749602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.750039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.831874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.840931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09ff4903-1060-40fe-80b5-57b4d8b4c80a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.166962 Sep 11 05:54:48.841510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1362/2495] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:48.847580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:48.848234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:48.854343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.855004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.855588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.856312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:48.856773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:48.857203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:48.890428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.898828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8273ac83-3df3-48cd-ae71-7828ad9f06a1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162009 Sep 11 05:54:48.899604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1134/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:48 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:48.986102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:48.994288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70996a5f-65d0-4787-b884-38bf9b79a574 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151834 Sep 11 05:54:48.994854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1363/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:48 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:49.257794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:49.258331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:49.264865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.265347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.265781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:49.266746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.267185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.267608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:49.395055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:49.404523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:49.405979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:49.407151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c3ce071-0120-4713-850a-1085f742e990 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153315 Sep 11 05:54:49.407853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1135/2498] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:49.864137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:49.864753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:49.871194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.871676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.872142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:49.872827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.873274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.873696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:49.922899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:49.923538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:49.929477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.929960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.930403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:49.931094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:49.931552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:49.931978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:50.007736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.016223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c7e4922-79db-4a0b-a187-ee29c2d5b818 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155955 Sep 11 05:54:50.017078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1364/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:50.021506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:50.022115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:50.028489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:50.028976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:50.029412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:50.030104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:50.030558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:50.031003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:50.066989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.076024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b0ab00b-5723-4a00-8ee3-107050197548 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156919 Sep 11 05:54:50.076612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1136/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:50.159781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.168622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8739bac0-d29a-4d08-ae5e-84e74bc1e2b7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150614 Sep 11 05:54:50.169191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1365/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:50.432237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:50.433543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:50.440110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:50.440619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:50.441033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:50.441717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:50.442631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:50.442631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:50.579456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.581716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:50.589755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.591401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:50.592622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82fbcd79-f866-4bc3-b340-a68995f6bae7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.164340 Sep 11 05:54:50.593181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1137/2502] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:51.040360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:51.040973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:51.047674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.048206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.048643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.049332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.049787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.050211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.099398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:51.100208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:51.106602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.107090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.107533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.108265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.108727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.109157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.180164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.188876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c894dfa3-2ec1-4046-891c-02fcf64a9d4d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152365 Sep 11 05:54:51.189460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1366/2503] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:51 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:51.193982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:51.194590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:51.201068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.201552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.201997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.202691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.203147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.203573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.242796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.251747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c554cbc4-b447-447c-a4fd-be082324914b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156167 Sep 11 05:54:51.252473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1138/2504] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:51 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:51.333581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.342218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1a0ddc2-3d15-48cf-84c4-6d30cc450a7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151823 Sep 11 05:54:51.342786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1367/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:51.618071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:51.618704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:51.625266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.625835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.626269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.626953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:51.627411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:51.627832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:51.755060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.764088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.765724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:51.767169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25b5670b-f212-4ffb-a856-e203e59f0aa5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152967 Sep 11 05:54:51.767731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1139/2506] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:52.212162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:52.212793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:52.214846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:54:52.215003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c (ip 10.222.0.33) !!! Sep 11 05:54:52.221258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.221741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.222180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.222873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.223326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.223753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.274663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:52.275252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:52.281559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.282038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.282496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.283183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.283654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.284105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.355207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.364212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-215cf1b2-994d-4b3a-b3da-be0f98fcda5b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155813 Sep 11 05:54:52.364784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1368/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:52 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:52.369463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:52.373458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:52.384937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.385432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.386399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.387631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.388118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.388545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.418976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.427257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b723598-89f0-4563-9de9-5aaa6930e061 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156436 Sep 11 05:54:52.427960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1140/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:52 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:52.522807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.532076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5c413e4-42ae-4853-8aec-595c44509b81 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166339 Sep 11 05:54:52.532638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1369/2509] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:52.792442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:52.793080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:52.799496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.800020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.800478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.801187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:52.801647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:52.802069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:52.937357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.945917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.947384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:52.949275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d54125c5-48fa-414e-991d-008b2f37f008 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160467 Sep 11 05:54:52.950001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1141/2510] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:52 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:53.394952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:53.395565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:53.402110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.402527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.402963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.403648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.404129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.404557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.450419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:53.451017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:53.456990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.457475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.457910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.458604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.459076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.459490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.534145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:53.544117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a8816bf-9307-4de3-bb62-d62569956112 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153267 Sep 11 05:54:53.544710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1370/2511] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:53.555072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:53.555837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:53.561987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.562475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.562909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.563609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.564088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.564514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.590030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:53.598347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-626643a4-4804-4cb8-9181-d2d81f5c134a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151912 Sep 11 05:54:53.598915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1142/2512] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:53.699545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:53.707589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ff6fa68-2e82-4798-a270-ff00ea229860 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156200 Sep 11 05:54:53.708176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1371/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:53.974937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:53.975504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:53.982146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.982630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.983075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:53.983766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:53.984249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:53.984679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.114928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.123695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.125174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.126350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ae911da-ac83-4dd5-9474-d43a05cec2ce tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155473 Sep 11 05:54:54.126910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1143/2514] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:54.568909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:54.569522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:54.577064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.577546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.577975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.578654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.579105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.579524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.622524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:54.623170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:54.629482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.629968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.630410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.631115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.631576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.632034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.711291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.720863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc6339c9-19c8-472f-9360-4e3ceca3b412 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155755 Sep 11 05:54:54.721657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1372/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:54.746601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:54.746601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:54.748398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.748888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.749321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.750024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:54.750475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:54.750900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:54.766206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:54:54.767716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.777378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8aafc57-4a06-4377-a058-9eca9f600f04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159018 Sep 11 05:54:54.782302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1144/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:54 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:54.892388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:54.900669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d8e27df-3124-4548-8ccd-a161fce91e9c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.163395 Sep 11 05:54:54.901238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1373/2517] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:55.152298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:55.152796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:55.159120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.159601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.160057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.160747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.161201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.161623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.295003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:55.303393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:55.304853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:55.306068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b825c42-489b-4dae-8afa-1d76d6392890 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157813 Sep 11 05:54:55.306623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1145/2518] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:55.748957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:55.749594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:55.756120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.756609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.757046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.757746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.758202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.758633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.801717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:55.802475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:55.812562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.813060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.813501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.814341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.814955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.815420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.898177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:55.906999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b65072bf-7d6a-4946-bbd2-b899f395e617 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.162745 Sep 11 05:54:55.907575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1374/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:55.924508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:55.925123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:55.930963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.931453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.931891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.932690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:55.933156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:55.933582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:55.955175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:55.964852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b17038af-3f48-441e-9058-fe3f0d495e81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.166275 Sep 11 05:54:55.965580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1146/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:56.062443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:56.070545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb95d48e-9a46-4ebe-9402-fa68c2f9c777 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149942 Sep 11 05:54:56.071108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1375/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:56.332417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:56.333038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:56.340150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.340636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.341079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:56.341803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.342262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.342692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:56.468750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:56.477294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:56.478726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:56.480531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-754ae3a4-0b95-4d23-9bac-372871754469 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151363 Sep 11 05:54:56.481089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1147/2522] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:56.930635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:56.931253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:56.938045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.938530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.938969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:56.939686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.940173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.940614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:56.988711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:56.989313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:56.996115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.996901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.997379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:56.998085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:56.998548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:56.998986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:57.074461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.083267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dde82b7f-0816-42f5-91b3-ba1fcf5420a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156483 Sep 11 05:54:57.083858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1376/2523] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:57.096200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:57.097124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:57.103178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:57.103786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:57.104263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:57.105488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:57.105940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:57.106370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:57.136630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.145110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a7cc105-213c-47b8-8baa-9cd8ef6dd4ad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160241 Sep 11 05:54:57.145684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1148/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:57.235735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.243976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5214e3b-4a6b-4c69-a84e-86d75e871741 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154140 Sep 11 05:54:57.244562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1377/2525] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:57.505255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:57.505858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:57.512552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:57.513026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:57.513459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:57.514157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:57.514590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:57.515009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:57.648358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.657420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.658865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:57.660057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-edf084d9-13a9-435e-8de5-0692599c1a6b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158787 Sep 11 05:54:57.660621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1149/2526] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:58.106035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:58.106654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:58.113082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.113569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.114009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.114697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.115169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.115579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.168354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:58.169027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:58.174934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.175413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.175847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.176587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.177040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.177459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.244872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.253921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd064e94-2820-48d8-976f-e6b98f71a0db tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151770 Sep 11 05:54:58.254647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1378/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:58 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:58.268077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:58.268699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:58.274519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.275007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.275446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.276187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.276705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.277129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.310602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.319012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d22b28a-eaf2-44c1-bf34-65d0b4164f12 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154867 Sep 11 05:54:58.319694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1150/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:58 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:58.408629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.416709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b135d05f-14fb-44cf-a458-3439f3940140 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152676 Sep 11 05:54:58.417908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1379/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:58.686256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:58.686877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:58.693347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.693935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.694378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.695163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:58.695546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:58.696049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:58.825283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.835205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.836680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:58.837860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-100c6743-a854-4a0d-b901-800403c33cc7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156292 Sep 11 05:54:58.838424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1151/2530] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:54:59.279228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:59.279774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:59.285705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.286184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.286615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.287297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.287746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.288205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.343422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:59.344092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:59.350270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.350746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.351181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.351866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.352348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.352770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.416833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:59.425176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-421ccc9b-4bfd-423f-be73-a3399a1aaf0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150864 Sep 11 05:54:59.425752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1380/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:59.440756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:59.441437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:59.447293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.447885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.448894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.449586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.450042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.450468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.481324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:59.489680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-769250e1-4133-4575-9a64-92e936d366ea tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151034 Sep 11 05:54:59.490249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1152/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:54:59.583742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:54:59.592078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e84fbd5-ce20-4ce8-8ce6-5ee5f0f96e4b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155116 Sep 11 05:54:59.592640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1381/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:54:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:54:59.863538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:54:59.864193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:54:59.871707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.872221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.872661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:54:59.873349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:54:59.873800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:54:59.874221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.004329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.013078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.014523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.015698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d8f26085-4829-4c86-b1ce-4a4019010f20 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156089 Sep 11 05:55:00.016290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1153/2534] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:54:59 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:00.447911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:00.449435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:00.451424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:55:00.451552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 05:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c (ip 10.222.0.33) !!! Sep 11 05:55:00.457558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.458047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.458489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.459192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.459651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.460110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.515017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:00.515901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:00.522225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.522705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.523141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.523884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.524368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.524786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.540209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:00.593945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.602376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc5ebd20-cd0f-4778-9b3a-29c1553e9517 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158339 Sep 11 05:55:00.603041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1382/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:00.614376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:00.615113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:00.622228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.622714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.623150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.623844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:00.624375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:00.624832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:00.657027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.665274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26d0570a-175c-443f-b6f9-d51ced6d2199 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155621 Sep 11 05:55:00.665848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1154/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:00.756539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:00.765597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82364225-2610-46bd-b755-a957bdc03dab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154848 Sep 11 05:55:00.766160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1383/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:01.040732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:01.041258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:01.047643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.048164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.048608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.049300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.049751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.050285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.186001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.194459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.195893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.197079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e858dff3-631f-402d-914a-fb65a423f905 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160364 Sep 11 05:55:01.197634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1155/2538] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:01.627036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:01.627679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:01.634212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.634785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.635225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.636797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.637262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.637700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.688750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:01.689378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:01.695722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.696243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.696680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.697373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.697833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.698324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.830089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.838401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b34dc389-e89e-4b22-838c-57da5e7ceeac tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153476 Sep 11 05:55:01.839500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1156/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:01 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:01.844356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:01.844963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:01.850471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.850957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.851386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.852097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:01.852551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:01.852970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:01.858394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.866845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-140ac57c-ea35-46c2-8a87-c0c778553934 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.243670 Sep 11 05:55:01.867653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1384/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:01 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:01.987470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:01.996449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-319a09ff-8727-4199-b381-eec41bddc0e9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155559 Sep 11 05:55:01.997169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1157/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:02.222836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:02.223478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:02.230221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.230709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.231143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:02.231822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.232326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.232749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:02.362499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:02.371179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:02.372646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:02.373794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63e9347d-10f1-4e04-9f64-dc2cd9165e18 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154811 Sep 11 05:55:02.374347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1385/2542] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:02.867342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:02.867963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:02.874556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.875047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.877534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:02.878358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.878970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.879456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:02.890580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:02.891198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:02.893928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:02.899300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.899785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.900250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:02.900949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:02.902033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:02.902461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:03.009682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.019034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96fcf822-5558-470d-91d4-de5d3a364b2f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160083 Sep 11 05:55:03.019606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1158/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:03.024250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:03.024858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:03.030207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:03.032196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.032409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:03.033286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:03.033727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:03.034430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:03.034887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:03.035336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:03.040580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96d01d68-f00c-4fc0-9787-121fe5ebc309 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153803 Sep 11 05:55:03.041174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1386/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:03.163302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.173095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9bb5a04-21cb-46e0-a167-ae2af15dfde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152450 Sep 11 05:55:03.173706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1159/2545] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:03.399443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:03.400086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:03.406441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:03.406956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:03.407401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:03.408155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:03.408614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:03.409044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:03.538210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.546809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.548287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:03.549473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-042912cb-b742-4136-8c38-e8340cbaeb9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154177 Sep 11 05:55:03.550030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1387/2546] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:04.043616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.044317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.050633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.051115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.051547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.052270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.052719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.053139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.063199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.064078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.070761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.071326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.071875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.072691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.073316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.073899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.190215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.199494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-441c1af5-b65d-48c6-b169-45d667d2b3e3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160728 Sep 11 05:55:04.200107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1160/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:04 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:04.204584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.205189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.211016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.211509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.211952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.212675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.212808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.213134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.213562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.222534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5049699f-cd2b-47b0-8fa8-833b332a4b39 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.163175 Sep 11 05:55:04.223115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1388/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:04.284654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.285149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.290954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.291450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.292296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.293271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.293737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.294213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.320322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:55:04.335041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:04.353483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.362433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de1d1862-5dbb-4328-aab6-0be58214f5fb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161346 Sep 11 05:55:04.363047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1161/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:04.402761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1e45741-3cd9-4c6d-9c13-07e1822ba71f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 204 len: 0 microversion: 2.1 time: 0.121454 Sep 11 05:55:04.403503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1389/2550] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:55:04 2022] DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:55:04.412415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.413028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.419890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.420414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.420853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.421552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.422011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.422441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.553428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.562489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0f9a5b50-ba28-4269-b60b-ac20410093e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1719 microversion: 2.1 time: 0.154181 Sep 11 05:55:04.563056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1162/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:04.575247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:04.575946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:04.581801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.582285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.582720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.583404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:04.583860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:04.584332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:04.711134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.719820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.721293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:04.722460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca54682a-53c9-4c70-a9cd-01bc4d227a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151501 Sep 11 05:55:04.723012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1390/2552] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:05.224224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:05.224846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:05.231311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.231797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.232272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.232968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.233432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.233860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.246748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:05.247447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:05.253785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.254263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.254694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.255381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.255831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.256299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.368371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.376684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a22217ae-881c-4063-9a8d-27696cb683c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156306 Sep 11 05:55:05.377582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1163/2553] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:05.391155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.397635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:05.398244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:05.399645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cafd4dbe-accd-4b80-a23f-ec5b38b90b06 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156925 Sep 11 05:55:05.400248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1391/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:05.404918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.405463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.405857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.406583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.407044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.407477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.536472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.544802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a4b01086-b724-42cd-9032-c5b8a948cd43 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151085 Sep 11 05:55:05.545370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1164/2555] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:05.586292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:05.586958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:05.593222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.593744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.594182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.594873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.595323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.595742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.722980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.731318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd92ebc8-9082-4aaf-ba8a-137fd7255ceb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1719 microversion: 2.1 time: 0.148952 Sep 11 05:55:05.731874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1392/2556] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:05.749151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:05.749759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:05.755611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.756128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.756572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.757259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:05.757714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:05.758139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:05.890792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.900618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.902212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:05.903412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce48ed50-5d43-4f79-bddb-19e5c4a559db tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158728 Sep 11 05:55:05.903989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1165/2557] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:05 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:06.401686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:06.402353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:06.408673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.409789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.410301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.411212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.411669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.413671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.424312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:06.424904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:06.434525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.435425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.436135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.437314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.437953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.438604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.572206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:06.580369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af427358-1c75-4a00-8b9e-90a02b3fa1c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.160040 Sep 11 05:55:06.580940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1166/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:06.585343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:06.585949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:06.592085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.592566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.593006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.593833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.594294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.594718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.613503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:06.622451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b938915-93f5-4439-ba04-807a4e2b9f6e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.225141 Sep 11 05:55:06.623226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1393/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:06 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:06.737507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:06.752294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85e3c5f0-b3a2-43a8-882e-f186fa1cfcd8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.170260 Sep 11 05:55:06.753722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1167/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:06.759458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:06.760396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:06.768232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.768959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.769619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.770777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.772087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.772737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.825995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca0a65-6128-4887-b447-6d6e1ddc91a5", "name": "network-vif-deleted", "tag": "031a32c6-4003-4a83-b703-6d1367f35137"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:55:06.852106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.852590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.853016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.867346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] Creating event network-vif-deleted:031a32c6-4003-4a83-b703-6d1367f35137 for instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 on hv-cinder-85692 Sep 11 05:55:06.867601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:06.875721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3048b1c9-9e18-48fb-be80-4e2d3c9b62ac req-8ab4123f-6b9e-453e-85c7-7901055daf6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141969 Sep 11 05:55:06.877157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1394/2561] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:55:06.878414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b0774700-0ae9-4df9-b266-6b3a4f8f6131 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1651 microversion: 2.1 time: 0.123300 Sep 11 05:55:06.880103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1168/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1651 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:06.930593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:06.931302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:06.939382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.939837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.940662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:06.941356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:06.941827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:06.942261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.076223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.085137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.086632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.087802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fb11b5e-71b0-4f0c-82e6-8f04b13908bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162027 Sep 11 05:55:07.088395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1395/2563] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:07.603697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:07.604391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:07.611095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.611520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.611961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.612695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.613160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.613591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.645941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:07.646568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:07.653886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.654624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.655065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.655768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.656254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.656683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.767755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.778197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2f2ff5c-d667-498c-8e3f-4277e394cb2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.178529 Sep 11 05:55:07.778777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1169/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:07.783756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:07.784399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:07.790479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.790976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.791474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.792314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.792776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.793208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.806811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.815779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a45c65af-1369-4c70-84a6-dd753fdd94a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.173612 Sep 11 05:55:07.816481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1396/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:07 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:07.902946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:07.903661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:07.909612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.910098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.910533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.911225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:07.911698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:07.912130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:07.934023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.942502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b576b1a-1b76-4d62-a5dd-ed0c31b0846a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.162503 Sep 11 05:55:07.943084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1170/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:07.976872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:07.985124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58fb21a7-ddec-4e6e-b035-41dc7dbaad26 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086306 Sep 11 05:55:07.985685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1397/2567] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:08.116477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:08.117022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:08.123684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.124203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.124642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.125336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.125797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.126226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.130113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:08.252108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:08.260803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:08.262479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:08.263654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1a17f06-4184-48af-a577-06c95d0c4d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151187 Sep 11 05:55:08.264242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1171/2568] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:08.801728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:08.802484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:08.809195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.809678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.810137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.810864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.811321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.811754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.840643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:08.841253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:08.847697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.848217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.848658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.849354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.849803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.850227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.943211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:08.952104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ed92d1b-6442-42fc-b1d6-608089da87c2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154372 Sep 11 05:55:08.952770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1398/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:08.967491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:08.968276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:08.974482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.975041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.975570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.976363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:08.976886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:08.977381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:08.985990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:08.994195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ebf00b86-4aa0-4dac-912b-8fe32046649f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158228 Sep 11 05:55:08.994833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1172/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:09.008223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:09.008977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:09.015496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.015978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.016713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:09.017411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.017871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.018296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:09.081042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:09.089854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a1c90b4-88ad-4d03-bd84-d54d30424c64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085390 Sep 11 05:55:09.090422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1173/2571] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:09.107767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:09.115953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d919cbed-d394-4905-8657-38a002ededa5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153404 Sep 11 05:55:09.116538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1399/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:09.288814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:09.289419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:09.295709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.296223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.296661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:09.297344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.297795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.298218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:09.423420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:09.431964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:09.434410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:09.435580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cbe2afd2-e8ab-46c1-9147-ca281c9f7be5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.150675 Sep 11 05:55:09.436167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1174/2573] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:09.976358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:09.976981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:09.983581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.984106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.984547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:09.985238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:09.985722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:09.986148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.017968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:10.018692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:10.025139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.025622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.026153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.026884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.027342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.027774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.117449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.126587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11c8e16b-3ded-4706-bd14-3701d4623503 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154151 Sep 11 05:55:10.127159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1400/2574] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:10.144495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:10.145385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:10.151719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.152250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.152699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.153394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.153855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.154288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.161197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.170372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-623a50df-15bd-4a0e-94c9-439c593dfb20 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156399 Sep 11 05:55:10.170982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1175/2575] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:10.175441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:10.176323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:10.182085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.182627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.183065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.183760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.184246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.184674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.216454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.224814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fff1f98-0608-457b-87d4-08f4453a64c2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084353 Sep 11 05:55:10.225400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1401/2576] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:10.311770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.319962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf134bf9-8df9-42db-a7ef-b495265db2ff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147985 Sep 11 05:55:10.320496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1176/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:10.461294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:10.461909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:10.467942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.468464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.468906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.469592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:10.470050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:10.470473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:10.600390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.609878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.611302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:10.612506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dde9af1a-bb6b-4f86-9b54-52a0edc019cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155177 Sep 11 05:55:10.613055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1402/2578] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:11.149198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:11.149906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:11.156835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.157315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.157776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.158637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.158912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.159331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.193711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:11.194329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:11.201378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.201871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.202326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.203058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.203517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.203941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.291056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.299789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3cb845d-ce0b-4e05-9de9-b216013d65a1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154221 Sep 11 05:55:11.300424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1177/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:11.304930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:11.305540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:11.311358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.311846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.312397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.313095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.313551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.313976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.337243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.346244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a88beaae-be58-4a64-a950-17fd3fdf6761 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156336 Sep 11 05:55:11.346826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1403/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:11 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:11.351396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:11.352026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:11.358144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.358633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.359267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.359973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.360455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.360887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.377621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.386591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-84236c2e-5818-4a18-ac3c-6ef47f3402a1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084948 Sep 11 05:55:11.387241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1178/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:11.487662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.496427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-496f0550-e6c3-48c4-a130-13cbf219c02e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148535 Sep 11 05:55:11.496996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1404/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:11.638689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:11.639210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:11.645379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.645855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.646287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.646969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:11.647419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:11.647838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:11.774781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.783563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.785017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:11.786176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-19e0b3db-b5be-4ee1-856d-3b79340a0bfd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152449 Sep 11 05:55:11.786736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1179/2583] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:12.323488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:12.324139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:12.330442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.330925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.331365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.332075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.332533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.332959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.369845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:12.370495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:12.377189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.377674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.378109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.378804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.379256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.379676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.518595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.528150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2d5cf3f-3302-46f2-ac03-76b4287034f0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162068 Sep 11 05:55:12.528747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1180/2584] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:12.533330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:12.533934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:12.540188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.540714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.541094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.542593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.543570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.544381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.610483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.623948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88c6e9d8-6ce0-441a-b703-c57fc55a41f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.094047 Sep 11 05:55:12.624576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1181/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:12.629707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:12.630316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:12.637299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.637800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.638241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.638942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.639400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.639850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.718169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.720514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:12.728363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1c67509-1b93-4ec0-bf6d-b71ee463aa52 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.408990 Sep 11 05:55:12.729041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1405/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:12.787721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.796671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2b288dd-2601-48a7-8272-32cfb1d44bf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.170968 Sep 11 05:55:12.797235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1182/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:12.811920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:12.812559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:12.819868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.820429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.820867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.821554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:12.822007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:12.822430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:12.953252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.961878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.963431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:12.965136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-802a432b-0337-4986-9ebc-2dc17231fbec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157622 Sep 11 05:55:12.965698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1406/2588] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:12 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:13.551392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:13.551924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:13.559289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.559775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.560242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.560928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.561378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.561798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.648159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:13.648775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:13.655401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.655890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.656370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.657094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.657555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.657982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.693408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:13.702371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26295737-416c-4f93-b8d9-fdd2e4adeec5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154808 Sep 11 05:55:13.702950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1183/2589] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:13.720470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:13.728745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8bb7ca2-22da-4be6-a5d5-ea7de6afd518 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084425 Sep 11 05:55:13.729936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1407/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:13.752089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:13.752698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:13.758561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.759040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.759478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.760203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.760671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.761095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.820038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:13.820661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:13.826667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.827151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.827590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.828325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.828784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.829215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.889982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:13.898550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f22be9f6-db5d-4c09-a3d0-555956ec7203 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150268 Sep 11 05:55:13.899119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1184/2591] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:13.959912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:13.968732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64f0a2a9-245b-4e30-b0a4-93507f247936 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152577 Sep 11 05:55:13.969301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1408/2592] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:13.990156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:13.990764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:13.996777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.997298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.997742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:13.998441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:13.998899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:13.999328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.127641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:14.136706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:14.138171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:14.139380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b53e891-f300-4f86-9a96-76a20a299823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153176 Sep 11 05:55:14.139945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1185/2593] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:14.725365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:14.725986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:14.732595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.733093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.733533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.734227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.734694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.735124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.752062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:14.752671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:14.759208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.759705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.760821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.761686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.762176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.762612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.825337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:14.833965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2330c049-8dac-4693-966a-d21eedabcdae tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085749 Sep 11 05:55:14.834543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1186/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:14.870711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:14.878943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a00850a-a735-429c-8d02-bb762f8621ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157424 Sep 11 05:55:14.879527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1409/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:14.923188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:14.923829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:14.929887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.930375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.930815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.931506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:14.931962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:14.932995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:14.992515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:14.993165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:14.999790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.000314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.000755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.001460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.001925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.002475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.064668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.066891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:15.076770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61daa07b-60ec-465b-95a6-1dc4079e3235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157384 Sep 11 05:55:15.077347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1187/2596] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:15.135885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.144421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acec4b2c-ddf8-41d0-9b5e-67ecdd00198d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155864 Sep 11 05:55:15.144993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1410/2597] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:15.165076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:15.165701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:15.172275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.172757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.173199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.173893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.174353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.174781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.302765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.311798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.313259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.314411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2aa0f613-87ab-4412-bc57-66688a6d8a4c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153203 Sep 11 05:55:15.314964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1188/2598] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:15.858768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:15.859361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:15.865916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.866408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.866847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.867546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.868030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.868464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.906079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:15.906848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:15.913492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.913989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.914436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.915139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:15.915926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:15.916405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:15.948528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:15.959691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6bd59d0-45ee-44fb-9b36-9e0de7881911 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.106284 Sep 11 05:55:15.960334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1411/2599] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:16.069587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.079652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-66224311-d9e0-4fa1-8099-d2299af9993e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.180420 Sep 11 05:55:16.080275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1189/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:16.100756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:16.101453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:16.110796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.111588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.112435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.113576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.114667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.114667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.166742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:16.167357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:16.173382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.173863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.174733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.175060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.175517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.175981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.263384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.272578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4edad52a-9eeb-4132-8409-d6d6702553c0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.175706 Sep 11 05:55:16.273247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1412/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:16.332288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.338701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:16.339420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:16.341005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e13da0b-2866-42a4-a7c4-4555db9e2e3c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.178147 Sep 11 05:55:16.341595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1190/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:16.345734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.346218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.346805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.347414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.347872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.348333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.505333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.514947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.516690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:16.517853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00bb22e1-8045-4e6d-9cda-0e876435702b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.183017 Sep 11 05:55:16.518418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1413/2603] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:16.986331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:16.987309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:16.994029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.994639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.995271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:16.995973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:16.996490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:16.996918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.063526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.071902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30df93d8-1d75-4791-8ed8-d903243280f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089458 Sep 11 05:55:17.072625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1191/2604] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:17.102643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:17.103268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:17.110712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.111229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.111666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.112452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.112907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.113342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.246742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.255485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae9e9484-a6a3-42ac-8c30-f0b4415a0743 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156657 Sep 11 05:55:17.256125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1414/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:17 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:17.297293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:17.298020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:17.304153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.304667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.305107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.305789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.306270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.306684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.375174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:17.375788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:17.381820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.382304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.382752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.383509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.383963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.384457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.442563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.452094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7bf34d4e-fe25-4f33-826e-426b4b21b0c1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158595 Sep 11 05:55:17.452876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1192/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:17.528673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.537603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-551abd44-d9f6-43e5-a348-15c84092226b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166444 Sep 11 05:55:17.537913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1415/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:17.543518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:17.544513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:17.550480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.550987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.551429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.552220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:17.552684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:17.553114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:17.679286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.688620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.690065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:17.691239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ade8861-e8a3-436c-810a-9048af62fded tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152576 Sep 11 05:55:17.691797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1193/2608] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:17 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:18.095452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:18.096093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:18.102150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.102637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.103075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.103772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.104427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.104871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.166038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.174781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cfaf06c4-213e-4961-88ae-f39c51073154 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083293 Sep 11 05:55:18.175343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1416/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:18.279532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:18.280202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:18.286680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.287167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.287607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.288403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.288866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.289297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.419277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.427406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82b035a4-3ee1-4409-80cd-1e6d04073146 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152452 Sep 11 05:55:18.427971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1194/2610] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:18.474510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:18.475124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:18.481741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.482231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.482669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.483367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.483821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.484273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.561080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:18.561688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:18.567530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.568069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.568505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.569188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.569639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.570057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.614633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.623052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-548e124b-7cdf-4915-a937-116c9eaf77da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152255 Sep 11 05:55:18.623562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1417/2611] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:18.699357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.707527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6356f6c-81c6-435c-92d2-eee30b6c7eb9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150294 Sep 11 05:55:18.708115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1195/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:18.717044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:18.717746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:18.723729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.724320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.724763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.725453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:18.725904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:18.726330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:18.859465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.868284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.870379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:18.871717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd07252c-699e-422e-8695-dbfba4891c5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159115 Sep 11 05:55:18.872320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1418/2613] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:19.198398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:19.199014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:19.204984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.205470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.205911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.206600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.207057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.207486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.273677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:19.282615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3feb4e30-31e3-41aa-b620-eb6b4427126d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088354 Sep 11 05:55:19.283198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1196/2614] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:19.450836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:19.451410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:19.458052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.458540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.458980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.459682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.460170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.460605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.587311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:19.596114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7223c00-dee8-4323-b668-585c1a5946b5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149798 Sep 11 05:55:19.596678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1419/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:19 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:19.646380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:19.646993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:19.654086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.654570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.655008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.655695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.656200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.656628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.731847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:19.732403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:19.738332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.738822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.739266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.739966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.740454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.740881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.788653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:19.797394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bdf64a93-a23d-4dfa-a0ff-3c2eb784f692 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154779 Sep 11 05:55:19.797974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1197/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:19.872985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:19.881183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50edb0e2-014e-4aca-9b71-97813f8f9c4c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154242 Sep 11 05:55:19.881749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1420/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:19.897110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:19.897741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:19.903550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.904052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.904490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:19.905167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:19.905617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:19.906037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.034176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.045312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.046877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.048082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-55a4cff6-8386-4578-a9ca-127b2270a5fe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154919 Sep 11 05:55:20.048672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1198/2618] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:20.306120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:20.306665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:20.312858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.313350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.313795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.314489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.314949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.315380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.377011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.385718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f4d06be-7950-4986-80c8-4a16aa50011f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083025 Sep 11 05:55:20.386279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1421/2619] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:20.619072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:20.620244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:20.626310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.626797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.627241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.627933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.628418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.628852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.756789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.765608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-43c5b74e-7935-45f0-8c72-e1327b0d0a50 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150430 Sep 11 05:55:20.766177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1199/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:20.821622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:20.822240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:20.829456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.829944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.830384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.831077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.831535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.831963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.846588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:20.905581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:20.906103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:20.911975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.912565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.913012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.913710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:20.914304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:20.914588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:20.968807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:20.977225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d82fd189-8ba3-432c-9049-780ecf41ae38 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.159455 Sep 11 05:55:20.977796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1422/2621] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:21.045166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.053398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64404da9-dc0d-4400-92fe-6cbe5b18e390 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151972 Sep 11 05:55:21.053971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1200/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:21.073611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:21.074217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:21.080091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.080574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.081005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.081683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.082132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.082554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.212704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.221293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.222729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.223886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87f2bb16-fb04-4588-838b-8591ae70c10a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154280 Sep 11 05:55:21.224484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1423/2623] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:21.409556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:21.410175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:21.417006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.417610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.418051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.418745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.419204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.419635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.479819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.487900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd0aed37-5f8f-4514-a0c0-90fc41d11a87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082234 Sep 11 05:55:21.488498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1201/2624] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:21.789121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:21.789655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:21.796471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.796955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.797384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.798069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:21.798518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:21.798939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:21.929016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:21.937834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1763382-dd0d-4788-8482-b7c7afc9fc2d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152657 Sep 11 05:55:21.938400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1424/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:22.001718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:22.002325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:22.008768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.009246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.009678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.010385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.010832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.011249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.077622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:22.078341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:22.084567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.085137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.085638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.086403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.086925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.087417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.231011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.239916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-611ab383-56fe-4cb6-9c94-2c787d2cacca tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166314 Sep 11 05:55:22.240526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1425/2626] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:22.249936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:22.250685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:22.256821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.257403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.257901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.258665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.259122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.259543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.363781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.372188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-829e78e8-89b4-4fdf-86e5-9335ac857444 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.374231 Sep 11 05:55:22.372768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1202/2627] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:22.391982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.400741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.402803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.403978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9883c56-8788-4314-a605-0809919918e5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157883 Sep 11 05:55:22.404564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1426/2628] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:22.509610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:22.510770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:22.517101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.517585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.518029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.518722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.519184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.519620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.580195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:22.588884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b860d90b-a114-4936-b6dd-46ed479ef2f1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082428 Sep 11 05:55:22.589452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1203/2629] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:22.960955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:22.961496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:22.968377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.968860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.969297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:22.969978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:22.970460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:22.970882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.102147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.111284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b1f2004-6744-41d3-8adc-391dcce166b6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154255 Sep 11 05:55:23.111855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1427/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:23.264063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:23.264624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:23.271280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.271767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.272246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.272935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.273388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.273810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.289738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:23.396307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:23.396917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:23.402829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.403234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.403720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.404190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.404886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.405336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.405755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.411090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7df64aa6-194f-426d-85e7-c84e4c4d29ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151119 Sep 11 05:55:23.411653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1204/2631] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:23.428619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:23.429351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:23.436548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.436710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.437129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.437823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.438277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.438701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.540086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.549796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01385178-eb08-4e9f-8c8d-ba565207e649 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157362 Sep 11 05:55:23.550373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1428/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:23.567649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.576182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.577618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.578779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ca6f5b5-9ac1-4fe8-9120-a43832c13ec7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153953 Sep 11 05:55:23.579330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1205/2633] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:23.610914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:23.611540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:23.617421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.617906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.618348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.619034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:23.619501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:23.619933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:23.681223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:23.689419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-381fbc1e-ae15-44cf-b22b-479fccc29ef9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082347 Sep 11 05:55:23.689983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1429/2634] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:24.135517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:24.136226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:24.142475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.142951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.143382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.144093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.144550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.144971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.271687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.279931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69ff97bd-3016-48f4-8fd9-61cf46833259 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148816 Sep 11 05:55:24.280525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1206/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:24 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:24.435838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:24.436404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:24.442787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.443280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.443718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.444435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.444892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.445319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.573707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:24.574357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:24.574504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.580414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.580900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.581344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.582039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.582498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.582616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6185b3b9-14fc-4096-9e03-081d1ac74547 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151425 Sep 11 05:55:24.582926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.583197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1430/2636] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:24.604344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:24.604960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:24.610770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.611258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.611701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.612429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.612920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.613351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.716338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.725180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb67702d-9cd9-429b-b103-a45cde5b6126 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155936 Sep 11 05:55:24.725762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1207/2637] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:24.744017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:24.744981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:24.747935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.750944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.751427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.751862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.752587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:24.753039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:24.753464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:24.756498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.757989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.759289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9274b9f-bafd-4775-8f9e-f7fecf4fdf3a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159272 Sep 11 05:55:24.760579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1431/2638] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:24 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:24.816142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:24.824582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b4b16ff-0cb8-4867-82cb-14e94326619f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.097747 Sep 11 05:55:24.825149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1208/2639] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:25.302975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:25.303631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:25.309654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.310144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.310582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.311306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.311763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.312229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.438113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.446857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dbf17b19-b15b-4736-a1dc-1d64e8a2a1a5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147737 Sep 11 05:55:25.448026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1432/2640] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:25.607236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:25.607844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:25.610206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:25.615337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.615810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.616266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.616945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.617395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.617816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.745337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.749214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:25.749833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:25.751663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:25.754824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d85d758-9355-4fbe-b499-7d5b9ef2b234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151833 Sep 11 05:55:25.755479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1209/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:25.756916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.757461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.757904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.758605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.759061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.759554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.785172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:25.785884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:25.792357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.793061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.793628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.794470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.795018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.795517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.893043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.901272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7402007-a418-49fc-a969-04ef111d343d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156346 Sep 11 05:55:25.901841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1433/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:25.906980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:25.907588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:25.913273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.913763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.914206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.914902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:25.915357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:25.916045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:25.931025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.940102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.941544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.942711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b99d684-1ae2-4861-b90e-bb9234f36f93 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161440 Sep 11 05:55:25.943268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1210/2643] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:25.980142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:25.989245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c92c16e-e232-4e09-bee7-c8ec2a69c212 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085909 Sep 11 05:55:25.989804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1434/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:26.471760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:26.472389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:26.478387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.478861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.479299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.479976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.480547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.481208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.608699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:26.617224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-917a81ff-6907-49ed-8b63-0cb750e05900 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149341 Sep 11 05:55:26.617793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1211/2645] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:26.779352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:26.779923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:26.786407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.786891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.787329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.788053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.788512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.788964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.919272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:26.927811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:26.928061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41b23084-25b8-4cc3-9957-110e5e376a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152520 Sep 11 05:55:26.928615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1435/2646] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:26.928758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:26.935196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.935682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.936160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.936862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.937322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.937755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.967684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:26.968321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:26.974349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.974841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.975277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:26.975968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:26.976445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:26.976868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.069079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.077966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8439a8b1-b760-4bf4-94b1-fb70f0ef58f3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153980 Sep 11 05:55:27.078980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1212/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:27.082986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:27.083592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:27.089170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.089715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.090686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.091774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.091917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.092275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.111571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.120200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.122162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.123332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-844cf4e6-ef41-41ad-b113-5552b5be6ec2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159980 Sep 11 05:55:27.123892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1436/2648] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:27.154812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.162916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ab02841-0ce3-448c-9454-8859947c702e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083441 Sep 11 05:55:27.163474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1213/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:27.641396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:27.642269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:27.648288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.648772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.649209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.649917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.650370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.650799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.779306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:27.787603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea98eb9b-6fac-478b-a4e7-3276cc3c6de8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150077 Sep 11 05:55:27.788254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1437/2650] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:27.951427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:27.952082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:27.958442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.958924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.959363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:27.960074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:27.960539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:27.960965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.087385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.095540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c376b8f7-d67d-4d4a-a395-d136813c3bbe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148758 Sep 11 05:55:28.096132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1214/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:28.102034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:28.102632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:28.108828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.109309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.109748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.110428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.110879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.111302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.149368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:28.150002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:28.156273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.156750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.157185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.157877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.158328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.158748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.245219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.254097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f9f98b8-a2fa-4ff2-8ae3-317ce6f0f7b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155834 Sep 11 05:55:28.254671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1438/2652] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:28.259088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:28.259710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:28.266171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.266917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.267547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.268326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.268786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.269222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.273199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:28.291963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.300938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.302372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.303535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ddfa36c4-3168-4a39-aeb9-d26039907584 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157977 Sep 11 05:55:28.304173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1215/2653] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:28.330161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.338336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffc9f9db-8244-4ffb-aaf4-0524f823827e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082730 Sep 11 05:55:28.338892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1439/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:28.810490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:28.811096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:28.817265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.817746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.818214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.818928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:28.819378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:28.819921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:28.947184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:28.955488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca4997ec-43e3-40c9-9c23-40818b5c88b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149202 Sep 11 05:55:28.956218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1216/2655] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:29.118559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:29.119179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:29.125492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.125990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.126432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.127158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.127617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.128080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.253343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.262141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b33bb016-3c1e-4cb6-844e-151a06df813b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.146871 Sep 11 05:55:29.262779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1440/2656] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:29.278756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:29.279370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:29.285793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.286279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.286721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.287417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.287874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.288329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.329534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:29.330142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:29.336236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.336726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.337169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.337863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.338317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.338748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.422414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.430702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9bdbf8f-e88e-4e9e-9f7b-7a0b5cd3f49e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156336 Sep 11 05:55:29.431275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1217/2657] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:29.436707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:29.437329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:29.443195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.443677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.444135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.444833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.445284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.445705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.475758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.484585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.486037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.487223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5d7de00-1ffa-4464-a9e6-85a2baa6b386 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161601 Sep 11 05:55:29.487790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1441/2658] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:29.507628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:29.516971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed7a573d-b720-4fc5-a5dd-dcfc9afdb6b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084506 Sep 11 05:55:29.517533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1218/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:29.979058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:29.979673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:29.986287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.986777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.987246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:29.987938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:29.988428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:29.988853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.115749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.125134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-075f82b9-ca11-4d12-9516-fc6e9f8bd890 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150016 Sep 11 05:55:30.125796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1442/2660] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:30.286247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:30.286888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:30.293860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.294284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.294727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.295418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.295876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.296330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.423644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.431818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec4fd5a8-1f13-4518-85d6-00391e62e0a3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149432 Sep 11 05:55:30.432427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1219/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:30.454671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:30.455288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:30.461301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.461785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.462221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.462913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.463367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.463792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.513093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:30.513707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:30.519831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.520365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.520812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.521513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.521975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.522408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.597443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.606172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf57cf3b-86b4-4cb6-b1ed-591ac1632a94 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155106 Sep 11 05:55:30.612404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1443/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:30.617351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:30.618140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:30.625071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.625499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.625937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.626638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:30.627225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:30.627653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:30.661322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.670225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.671677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.672891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8c40de1-4581-4085-a311-0fdadadb5a99 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163888 Sep 11 05:55:30.673457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1220/2663] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:30 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:30.690385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:30.698802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7176d3fd-3d2f-4857-8173-ca66bc436b8e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085206 Sep 11 05:55:30.700018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1444/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:31.148475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:31.149088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:31.155520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.156021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.156463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.157143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.157597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.158020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.161824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:31.284212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.293410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d99cae49-ae87-478c-b3b1-f3cfb6889eff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148077 Sep 11 05:55:31.294134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1221/2665] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:31 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:31.456422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:31.456948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:31.463347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.463826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.464388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.465868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.466308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.466733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.595925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.604170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e87bc32-ed53-4b57-bd3e-b3ea77f5b942 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151703 Sep 11 05:55:31.604735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1445/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:31.629265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:31.629875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:31.635798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.636302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.637408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.638262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.638713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.639135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.699984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:31.700827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:31.706738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.707160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.707602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.708328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.708789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.709281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.771534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.779852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e74fa4e2-b515-4176-98a5-4582151fa529 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154363 Sep 11 05:55:31.788460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1222/2667] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:31.788460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:31.788460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:31.792854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.793543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.794177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.795741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:31.796355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:31.796899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:31.844459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.852951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.854387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.855603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-864e5b78-8b6d-48c5-b6bb-7d8f64307dd5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160233 Sep 11 05:55:31.856182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1446/2668] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:31.861602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:31.870052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8820404e-58a8-4e7b-a1ee-a06770fb779a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088580 Sep 11 05:55:31.870646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1223/2669] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:32.315939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:32.316607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:32.322524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.323004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.323442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.324201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.324772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.325204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.451514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:32.459766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04448a1e-9ae9-4c2f-8e6c-4e2ca8cbfbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147699 Sep 11 05:55:32.460384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1447/2670] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:32.627356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:32.627874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:32.634250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.634746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.635190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.635888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.636463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.636962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.763026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:32.771402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35af0494-3482-4931-8a88-da5b35ac1550 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148057 Sep 11 05:55:32.771968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1224/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:32.803712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:32.804351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:32.810944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.811427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.811862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.812567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.813018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.813439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.882435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:32.882957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:32.890262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.890385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.890805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.891511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.892281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.892709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.943912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:32.952744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12ef10db-c605-4dda-be8d-d4eeed7511b4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152830 Sep 11 05:55:32.962356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1448/2672] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:32.962356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:32.962356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:32.968581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.968581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.968581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:32.968581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:32.968993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:32.968993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.030189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.035242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.038972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.040453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.041623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4c337b6-ef2c-477a-9c85-10993ae120d6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163262 Sep 11 05:55:33.042182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1225/2673] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:33.044600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a7470db-9d5c-4c51-9051-c00a42a162a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090247 Sep 11 05:55:33.045228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1449/2674] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:33.483663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:33.484234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:33.490056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.490536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.490971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.491653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.492126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.492545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.620377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.628524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea5c47f9-8567-4f81-98ac-e8976920d1e1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149347 Sep 11 05:55:33.629099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1226/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:33.795705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:33.796293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:33.802263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.802742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.803175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.803860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.804346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.804771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.932312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:33.941330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2b8e3f6-5990-4412-884e-f965c9ad211a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150450 Sep 11 05:55:33.941899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1450/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:33.978476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:33.979110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:33.986059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.986537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.986968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:33.987645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:33.988125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:33.988546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.068214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:34.068831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:34.074962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.075449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.075888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.076611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.077071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.077507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.117672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.126105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02a9e6ab-3407-4f37-8983-e840d08b9210 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151438 Sep 11 05:55:34.126687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1227/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:34.131103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:34.131699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:34.137399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.137884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.138324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.139014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.139473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.139900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.140365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.148819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-436b8c7e-9f9e-4293-9bfc-4333bd48d1c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084630 Sep 11 05:55:34.149382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1451/2678] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:34.269058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.278304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.279765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.280934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7f6351ea-7ca0-4adb-87d8-86b8cb6cdda3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153342 Sep 11 05:55:34.281503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1228/2679] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:34.652829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:34.653363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:34.659319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.659800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.660266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.660949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.661398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.661818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.791560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:34.800108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7364f3c2-18ea-40a4-a3f8-b44911d2b18f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151909 Sep 11 05:55:34.800733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1452/2680] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:34.963737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:34.964296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:34.970957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.971439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.971922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:34.972672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:34.973130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:34.973559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.101583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.109950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4cdeb2e5-70bf-4fcc-aaa6-34e7955a8ef4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150210 Sep 11 05:55:35.110513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1229/2681] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:35.150187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:35.150806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:35.157697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.158180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.158618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.159304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.159759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.160221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.171974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:35.172730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:35.178970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.179530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.180071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.180856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.181384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.181905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.247906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.256126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0151b10f-db67-4f5a-8715-6ed4aa5f399a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088218 Sep 11 05:55:35.256704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1230/2682] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:35.288527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.297472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72b64f3b-0bba-4479-b7e1-89752c36270b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151081 Sep 11 05:55:35.298034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1453/2683] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:35.306317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:35.307036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:35.313557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.314041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.314481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.315198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.315654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.316104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.444195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.452710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.454145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.455343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f921179f-a9d4-4091-b635-996228ce1c6f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152962 Sep 11 05:55:35.455934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1231/2684] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:35.824611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:35.825405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:35.831492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.831974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.832438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.833124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:35.833604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:35.834032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:35.970672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:35.979092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c62d653d-66b7-4954-ae73-7819e47a16b3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159015 Sep 11 05:55:35.979671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1454/2685] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:36.132990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:36.133645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:36.140679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.141157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.141853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.142564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.143015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.143434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.270763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.279044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f0b72f8-1e2c-4933-a169-6b01c0dd7f45 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150137 Sep 11 05:55:36.279617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:36.279774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1232/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:36.280428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:36.286749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.287227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.287658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.288367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.288822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.289245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.320856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:36.321472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:36.327966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.328493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.328942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.329646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.330105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.330538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.351393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.353689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:36.361264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cb55100-2563-440b-8180-5cb48ba96aa9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085583 Sep 11 05:55:36.361944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1455/2687] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:36.460774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.468929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16cc84d6-779b-41bf-afd8-dc722b665569 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151877 Sep 11 05:55:36.469568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1233/2688] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:36.480847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:36.481543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:36.487487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.487973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.488449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.489145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:36.489602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:36.490033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:36.616984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.626542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.628016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:36.629152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09dd03cd-4297-412c-83e2-0bf3e8fca4e7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152143 Sep 11 05:55:36.629708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1456/2689] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:37.002572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:37.003222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:37.005245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:55:37.005404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:55:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 (ip 10.222.0.33) !!! Sep 11 05:55:37.012253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.012801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.013237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.013938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.014397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.014854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.143001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.151200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-888c6de4-07b4-4327-962b-103f58a7d95b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152517 Sep 11 05:55:37.151771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1234/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:36 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:37.302000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:37.302611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:37.309543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.310068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.310485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.311167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.311621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.312072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.383873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:37.384483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:37.391321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.392107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.392557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.393261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.393724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.394154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.443782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.452684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fb08bc8-a6fc-4d69-91e3-ae230da33e62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154524 Sep 11 05:55:37.453467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1457/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:37.458711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.467648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8976ae76-eaef-4c64-bd9d-677bc481b795 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087746 Sep 11 05:55:37.468373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1235/2692] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:37.492712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:37.493335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:37.499263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.499746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.500223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.500915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.501371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.501801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.632210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.641031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27deb8ef-5ae6-4876-aa49-0c64e8b0f1c7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152030 Sep 11 05:55:37.641532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1458/2693] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:37.655033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:37.655666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:37.661476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.661948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.662379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.663058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:37.663502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:37.663920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:37.804933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.814238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.815670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:37.816854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5f7f0625-e1c7-47e4-9d6e-61c176026de6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.166358 Sep 11 05:55:37.817406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1236/2694] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:37 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:38.174314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:38.174970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:38.180932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.181417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.181856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.182541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.182996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.183425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.309603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.317752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2b19be9-3a07-4dd1-b55f-7dc4e74a0cc1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147316 Sep 11 05:55:38.318310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1459/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:38 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:38.476653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:38.477218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:38.484325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.484799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.485514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.485994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.486448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.486872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.490335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:38.490954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:38.497128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.497628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.498060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.498757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.499214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.499649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.565329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.573613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbdc7d6e-de71-41b7-8e36-f6ca42f04ae3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087034 Sep 11 05:55:38.574216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1460/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:38.615860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.618034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:38.625279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74735986-6b6b-400a-80fd-9ce2287adf50 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152516 Sep 11 05:55:38.625846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1237/2697] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:38.664732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:38.665489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:38.672167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.672648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.673105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.673793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.674249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.674671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.805898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.814206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c74dea3a-e445-4c39-8aa4-6c30c934c339 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153334 Sep 11 05:55:38.814759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1461/2698] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:38.842576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:38.843188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:38.849057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.849540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.849978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.850664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:38.851119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:38.851548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:38.986407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.995210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.997383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:38.998556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b8eb08b-92e9-4816-939d-031685a13d44 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160436 Sep 11 05:55:38.999126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1238/2699] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:39.341830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:39.342537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:39.348892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.349370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.349804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.350512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.350964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.351384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.479527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:39.488576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8812923-e44a-4bb0-ab85-c6e53bd5061f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151104 Sep 11 05:55:39.489142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1462/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:39.596458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:39.597076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:39.603399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.603886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.604363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.605143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.605603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.606031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.648485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:39.649096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:39.655582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.656080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.656509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.657194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.657640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.658058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.668712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:39.677240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45bbd8cb-b231-48d5-90a2-7c02a761eea9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084619 Sep 11 05:55:39.677819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1239/2701] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:39.790114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:39.798469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a251e07-555c-455d-bdab-a0052485abb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153871 Sep 11 05:55:39.799033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1463/2702] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:39.837716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:39.838325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:39.845088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.845567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.846002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.846680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:39.847132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:39.847553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:39.975871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:39.984268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46e085a1-badf-4e3e-8cb4-21b8dd71a225 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150335 Sep 11 05:55:39.984834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1240/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:40.023802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:40.024360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:40.030378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.030855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.031288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.031965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.032443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.032865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.311950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.320465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.321906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.323063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cdc232b-70e2-4e87-a5fb-948e395f96d3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.303261 Sep 11 05:55:40.323615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1464/2704] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:40.512086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:40.512799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:40.519053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.519535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.519974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.520684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.521137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.521563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.652587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.660981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32bb7071-b7aa-4817-809f-126c5043ded9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153318 Sep 11 05:55:40.661554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1241/2705] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:40.700515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:40.701147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:40.707449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.707932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.708400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.709085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.709543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.709965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.774300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.782690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-388fc25f-ea98-483e-bc7f-3aab2d72cf27 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086712 Sep 11 05:55:40.783242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1465/2706] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:40.821881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:40.822489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:40.828899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.829372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.829807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.830515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:40.830966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:40.831385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:40.957518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:40.966335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b0378ce-d055-4113-b9eb-48035e3536e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148331 Sep 11 05:55:40.966903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1242/2707] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:41.008272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:41.008880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:41.015539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.016047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.016485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.017419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.017869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.018288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.145861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.154170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14286592-8b7d-4e67-a484-5da894144ba3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149799 Sep 11 05:55:41.154719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1466/2708] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:41.349157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:41.349802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:41.356257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.356743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.357186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.357881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.358339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.358774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.489700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.498282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.499756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.500955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aada5417-876d-4fc5-ab80-3252ad604cd3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155687 Sep 11 05:55:41.501519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1243/2709] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:41.684536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:41.685198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:41.691060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.691536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.691966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.692667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.693118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.693537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.805762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:41.806448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:41.813128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.813694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.814225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.814989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.815521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.816077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.820165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.828920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1247232-c685-4ca5-8be8-16e8fb3a5674 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148425 Sep 11 05:55:41.829490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1467/2710] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:41.879550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:41.888231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d604cee-7def-4607-a16d-f5edeb32633f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086434 Sep 11 05:55:41.888799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1244/2711] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:41.989506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:41.990045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:41.995915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.996512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.997247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:41.997932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:41.998383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:41.998806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.129727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.138431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd86e47d-935a-40f0-8184-9e92a47fb679 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152864 Sep 11 05:55:42.138988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1468/2712] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:42.178710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:42.179464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:42.186284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.186761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.187199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.187878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.188357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.188778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.315920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.324151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0843fff-8980-4e56-8094-def4ec616bcc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149563 Sep 11 05:55:42.325314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1245/2713] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:42.526235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:42.526786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:42.533297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.533785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.534227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.534921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.535377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.535810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.665612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.674350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.675801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.676999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ab2d668-5b9b-4f3e-8e6b-d32676ee602d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154747 Sep 11 05:55:42.677585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1469/2714] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:42.852446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:42.853057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:42.859804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.860318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.860755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.861447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.861899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.862323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.912197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:42.912935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:42.919667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.920383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.920818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.921498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:42.922030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:42.922455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:42.985692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:42.994286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ce8361c-fcd0-475a-a2de-42fc0626ee41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085970 Sep 11 05:55:42.994859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1470/2715] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:42.995968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.004947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8cbd97c-f052-4efb-ba4a-9de03ba5c640 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156339 Sep 11 05:55:43.005504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1246/2716] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:42 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:43.162506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:43.163115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:43.170037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.170520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.170952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.171630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.172107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.172529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.302045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.310568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-921d2bc9-03c7-4bfa-9404-9e57dba454c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151868 Sep 11 05:55:43.311124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1471/2717] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:43.347559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:43.348197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:43.353965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.354437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.354869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.355544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.356352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.356782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.483784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.491859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c6e5025-ef54-4864-b6d7-375f99050247 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148090 Sep 11 05:55:43.492444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1247/2718] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:43.703596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:43.704163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:43.710095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.710583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.711025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.711717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:43.712202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:43.712632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:43.727370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:43.841829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.850442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.851890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:43.853083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af22e0a3-86be-4a85-a85c-8cc50063079d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154325 Sep 11 05:55:43.853640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1472/2719] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:43 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:44.018123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:44.018704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:44.025253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.025736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.026178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.026873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.027331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.028308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.029822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:44.030438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:44.036703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.037183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.037613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.038304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.038789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.039209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.091073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:44.099494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c30d9de8-59f9-4f92-a665-bec4b05762bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085648 Sep 11 05:55:44.100189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1248/2720] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:44.170708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:44.178870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d0fdf2f-016c-458b-9558-8070925c4485 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153876 Sep 11 05:55:44.179432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1473/2721] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:44 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:44.334208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:44.334818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:44.341652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.342128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.342562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.343242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.343691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.344141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.473273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:44.482104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb3f5ba5-228d-4590-9c9a-62cf5c0f40b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151690 Sep 11 05:55:44.482685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1249/2722] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:44.514847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:44.515475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:44.521579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.522066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.522508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.523201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.523659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.524116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.651512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:44.660437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb2f1414-684f-44db-9440-2bf3decaa5b6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149659 Sep 11 05:55:44.660993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1474/2723] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:44.878051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:44.878658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:44.884631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.885114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.885550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:44.886254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:44.886694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:44.887692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.015887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.029031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.030485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.031698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50d61713-dd12-422b-b287-9cc2df3791ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157556 Sep 11 05:55:45.032325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1250/2724] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:45.125075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:45.125625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:45.132434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.132918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.133358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.134049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.134520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.134950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.197594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.201937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:45.202551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:45.205892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1023462-36ae-4440-b63d-af371a84cb37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084860 Sep 11 05:55:45.206458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1475/2725] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:45.208385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.208867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.209305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.210000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.210453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.210878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.343169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.351185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad250a52-f1d3-48a6-8e7d-35ea9c98d33e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153287 Sep 11 05:55:45.351752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1251/2726] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:45 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:45.505026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:45.505644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:45.511485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.512209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.512661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.513362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.513826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.514258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.649482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.658422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce39c239-f7f3-4e5d-9158-b8fbfc8f177b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157241 Sep 11 05:55:45.658984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1476/2727] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:45.683583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:45.684334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:45.690161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.690636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.691075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.691762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:45.692242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:45.692668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:45.820532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:45.828986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c3bf919-aca4-432c-a61f-dcb9c21b0466 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149334 Sep 11 05:55:45.829562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1252/2728] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:46.057101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:46.057641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:46.063818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.064340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.064784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.065473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.065957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.066387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.194930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.203495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.204995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.206169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fb9d168-eb37-492d-92e5-f00644971b38 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153043 Sep 11 05:55:46.206702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1477/2729] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:46.231875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:46.232561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:46.239087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.239572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.240018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.240715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.241165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.241584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.304642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.313718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d728323-2a06-4de5-9586-ea442bdaf592 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087844 Sep 11 05:55:46.314221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1253/2730] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:46.375190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:46.375801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:46.381688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.382168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.382603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.383280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.383728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.384181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.513763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.522191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82e519c4-2e55-44d5-b1b2-4198f8bc4c5e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151714 Sep 11 05:55:46.522755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1478/2731] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:46.681858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:46.682469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:46.689135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.689620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.690057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.690746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.691202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.691647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.706088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:46.822649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.831016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5b3dfc1-6202-4115-a6c1-56a612fcd5df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153093 Sep 11 05:55:46.831573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1254/2732] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:46.852277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:46.852893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:46.859330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.859814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.860278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.860969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:46.861423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:46.861849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:46.987487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:46.995706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d26b176-57a1-4c64-976d-0bf5abc51148 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147345 Sep 11 05:55:46.996505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1479/2733] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:47.230704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:47.231248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:47.237611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.238175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.238515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.239195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.239645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.240095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.336668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:47.337281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:47.344290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.344775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.345213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.345901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.346351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.346768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.367004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:47.375777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:47.377267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:47.378444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aaa72ed8-afe3-4622-8e80-26d99d389ca0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151758 Sep 11 05:55:47.379011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1255/2734] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:47 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:47.409495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:47.417566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3922c5a2-145b-407e-9b6f-aac45051bb0a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084666 Sep 11 05:55:47.418226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1480/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:47.545659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:47.546211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:47.552138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.552628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.553072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.553765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.554232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.554660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.684751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:47.692836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b8e33c2-d6a9-4fb0-ba96-bc7adf83be16 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151305 Sep 11 05:55:47.693401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1256/2736] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:47.854789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:47.855401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:47.862164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.862649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.863083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.863770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:47.864249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:47.864677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:47.993757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.002098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bdd3d33-4889-4bb1-9d52-7ad9c2824830 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151256 Sep 11 05:55:48.002658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1481/2737] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:48.022741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:48.023357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:48.030043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.030508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.030945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.031627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.032132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.032556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.158025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.166062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6204508-d7e1-444a-9feb-270e96c1e5aa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147096 Sep 11 05:55:48.166625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1257/2738] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:48.404596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:48.405128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:48.411580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.412102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.412553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.413243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.413701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.414132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.439923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:48.440561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:48.447075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.447564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.448059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.448761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.449265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.449837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.514071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.523289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3d14000-3fa7-408f-8f82-5342faecea47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086836 Sep 11 05:55:48.523639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1258/2739] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:48.545061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.553896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.555321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.556502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05b043bf-f72f-4cf8-98cf-2d02bcc4be39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156627 Sep 11 05:55:48.557088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1482/2740] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:48 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:48.716469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:48.717011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:48.718846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:48.724273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.724790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.725231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.725931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:48.726385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:48.726810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:48.858965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:48.867599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de4a9252-422b-403d-b3d0-f9d2c4f69432 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155991 Sep 11 05:55:48.868201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1259/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:48 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:49.025738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:49.026263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:49.028782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:49.034096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.034596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.035028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.035716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.036203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.036746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.167224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.175499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cc51445-bf37-4f97-8ab8-9177eb0dc572 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153694 Sep 11 05:55:49.176087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1483/2742] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:49.189547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:49.190161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:49.196078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.196566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.197009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.197700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.198158 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.198582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.325133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.333311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ada562b-0684-4518-9c59-1e3e75b507fb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147673 Sep 11 05:55:49.333884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1260/2743] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:49.547729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:49.548289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:49.554728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.555215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.555653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.556439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.556896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.557326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.583988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:49.584617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:49.591145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.591632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.592100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.592809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.593273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.593700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.619404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.628286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67a2a107-2d72-4fa2-8725-749d165e850f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085538 Sep 11 05:55:49.628858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1484/2744] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:49.722452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.731656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.733126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:49.734288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8bb3a98-7460-43c7-8167-7b351a9a1c74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154170 Sep 11 05:55:49.734864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1261/2745] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:49 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:55:49.890794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:49.891432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:49.897744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.898228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.898670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:49.899358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:49.899819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:49.900276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.025762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.034738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23f05210-6d3e-402b-a90c-79357d4e689e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147849 Sep 11 05:55:50.035301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1485/2746] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:50.199932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:50.200616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:50.206538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.207015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.207449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.208168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.208625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.209049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.338537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.347253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a287190b-77da-45c6-8352-5dacc91eacde tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151704 Sep 11 05:55:50.347818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1262/2747] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:50.356445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:50.357073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:50.362977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.363459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.363898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.364625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.365083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.365514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.499556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.507769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62129c0e-e340-48a9-869f-417d7223e8d8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155200 Sep 11 05:55:50.508363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1486/2748] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:50.652022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:50.653430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:50.660193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.660673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.661133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.661819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.662271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.662694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.724028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.733102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e877ca3a-f9ad-4efd-ae82-09ddbf14efdb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084972 Sep 11 05:55:50.733666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1263/2749] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:50.759642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:50.760318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:50.767212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.767696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.768175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.768865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:50.769322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:50.769749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:50.898092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.907283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.908763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:50.909925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb12a323-81ba-4f4c-9f24-1543ca1b8199 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154179 Sep 11 05:55:50.910491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1487/2750] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:50 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:51.057543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:51.058077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:51.064418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.064907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.065350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.066043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.066499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.066925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.196621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:51.205514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3bd42ea0-0d51-4e47-8e51-09d71cc4ecaf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151913 Sep 11 05:55:51.206087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1264/2751] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:51 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:51.370288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:51.370940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:51.377513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.377998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.378438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.379146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.379586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.380032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.506635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:51.515451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58e440c5-d1ca-4283-8795-dfc9d9433029 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148978 Sep 11 05:55:51.516029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1488/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:51.530576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:51.531307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:51.537300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.537777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.538212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.538891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.539341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.539761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.668897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:51.677051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4878cea1-7de2-4d6d-ad83-0083a93fe898 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150377 Sep 11 05:55:51.677626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1265/2753] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:51 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:51.755894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:51.756544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:51.762976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.763577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.763879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.764617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.765079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.765501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.768749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:51.831481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:51.839749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54ec19f5-8bad-40ac-a938-58409dd257ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087691 Sep 11 05:55:51.840938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1489/2754] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:51.935512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:51.936187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:51.942042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.942520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.942955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:51.943632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:51.944106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:51.944527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.073841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.082493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.083928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.085173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9cf0ea98-d033-4d38-a26a-cc6946fdb2cd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154436 Sep 11 05:55:52.085733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1266/2755] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:51 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:52.227534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:52.228139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:52.235614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.236132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.236571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.237264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.237720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.238146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.366809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.375348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73602421-3704-4ab6-a216-a5b6aab2cadf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151676 Sep 11 05:55:52.375910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1490/2756] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:52 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:52.538600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:52.539138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:52.545777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.546277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.546724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.547412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.547930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.548383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.678316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.687330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96a0d2e2-4898-43bb-8d76-fefcb5682e20 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152709 Sep 11 05:55:52.687890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1267/2757] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:52.700856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:52.701472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:52.708530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.709244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.709999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.710889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.711527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.712169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.841307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.849553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67d97f7a-0b8d-461c-81de-79857cd47c5a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152753 Sep 11 05:55:52.850124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1491/2758] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:52 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:52.862552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:52.863189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:52.869062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.869538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.869971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.870649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:52.871752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:52.872452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:52.932944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:52.941550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a32f0d8-377f-4cbe-a65f-0346ac90e168 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082838 Sep 11 05:55:52.942120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1268/2759] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:53.111223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:53.111878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:53.117833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.118314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.118744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.119423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.119872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.120319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.250754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:53.259113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:53.260564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:53.261911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f87e31f5-801f-4c6a-8f40-beb70714ad03 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154490 Sep 11 05:55:53.262753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1492/2760] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:53 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:53.397868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:53.398411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:53.404539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.405020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.405456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.406143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.406595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.407021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.533513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:53.541700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff3ff993-af21-45e1-9599-be7693b722c5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147763 Sep 11 05:55:53.542271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1269/2761] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:53.710806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:53.711335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:53.717805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.718287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.718810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.719497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.719949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.720395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.856286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:53.864546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59c49e1b-60ad-4514-b568-4516658c51a2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157827 Sep 11 05:55:53.865115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1493/2762] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:53.872672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:53.873285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:53.879486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.879960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.880418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.881099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.881551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.881968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.965495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:53.966112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:53.972076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.972569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.973010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:53.973708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:53.974165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:53.974595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.015694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.024644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69cc2612-3c7d-4276-81a5-b19ac9991ade tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156254 Sep 11 05:55:54.025229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1270/2763] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:54.040700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.049504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9144f585-941b-489c-b231-2dd107fed0d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088128 Sep 11 05:55:54.050062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1494/2764] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:54.287467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:54.288018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:54.294528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.295005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.295439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.296144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.296597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.297102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.299590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:54.424037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.437859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.439450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.440665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c9d2c6d-50c7-4d54-8b9c-fb2c451a724b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157204 Sep 11 05:55:54.441251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1271/2765] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:54 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:54.565248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:54.565871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:54.571882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.572395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.572831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.573514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.574521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.575014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.705349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:54.713499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f37ace8d-4439-4533-a7da-08a73ac818c4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152190 Sep 11 05:55:54.714059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1495/2766] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:54 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:54.888238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:54.888765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:54.895381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.895858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.896333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:54.897016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:54.897464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:54.897883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.028330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.036414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd1c99cb-10d9-441e-bd82-8748e3547ba1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152688 Sep 11 05:55:55.036978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1272/2767] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:55.048931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:55.053732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:55.056029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.056521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.056965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.057665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.058125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.059132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.072624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:55.073270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:55.079669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.080192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.080642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.081342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.081802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.082235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.143645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.152171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a4b5f7b-8d21-48da-8484-8b6400b0aa65 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083205 Sep 11 05:55:55.152931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1273/2768] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:55.188360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.196642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8a77cc7-f962-49fd-9502-588acdec4826 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151511 Sep 11 05:55:55.197206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1496/2769] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:55.467380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:55.467904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:55.473903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.474380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.474816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.475498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.475953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.476400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.606557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.615083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.616544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.617706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-87ccc311-11cd-4d48-a721-6e0509d397f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154451 Sep 11 05:55:55.618262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1274/2770] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:55 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:55.737567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:55.738097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:55.744269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.744769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.745234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.746004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:55.746468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:55.746900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:55.878261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:55.886380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39e20dbb-b7e2-475a-9202-0db5eefd5f78 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152713 Sep 11 05:55:55.887575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1497/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:56.061653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:56.062188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:56.068533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.069028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.069447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.070126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.070574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.070994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.175093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:56.175688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:56.181986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.182470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.182901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.184206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.184659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.185083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.202739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.210853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-905d2482-ddfa-4ff7-8fbb-4520263b74f8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153733 Sep 11 05:55:56.211404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1275/2772] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:56.220188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:56.220873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:56.226939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.227522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.228054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.228813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.229332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.229822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.248220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.256375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d405ebf0-f807-4c89-9882-679a2d1ed73a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085200 Sep 11 05:55:56.256943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1498/2773] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:56.357451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.365521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76380212-b890-4496-a525-d51986feb48c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148969 Sep 11 05:55:56.366087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1276/2774] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:56.643770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:56.644332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:56.650385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.650872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.651313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.652021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.653106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.653564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.781363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.789984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.791416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:56.792661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-044289f7-7bce-496e-ad28-179dfb30d480 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153159 Sep 11 05:55:56.794067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1499/2775] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:56 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:56.910666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:56.911243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:56.917179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.917877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.918325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:56.919023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:56.919487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:56.919914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.049522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.058033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e67382a0-b84e-4e5a-b663-0a2658066005 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151262 Sep 11 05:55:57.059531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1277/2776] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:57.234327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:57.234944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:57.241334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.241815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.242252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.242941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.243395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.243821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.279126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:57.279740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:57.286248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.286734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.287170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.287865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.288347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.288793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.351981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.361000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ece79bb3-76cd-491e-9a61-34ea88e5b2ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086198 Sep 11 05:55:57.361574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1278/2777] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:57.375009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.383290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd5dae00-336f-494d-a402-a538dbe31c22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153530 Sep 11 05:55:57.384445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1500/2778] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:57.389479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:57.390082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:57.396257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.396733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.397163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.397869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.398316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.398735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.524871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.533576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f875e5c6-fcb3-4df1-a2b8-aa31b260a72a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148372 Sep 11 05:55:57.534147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1279/2779] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:57 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:57.818758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:57.819368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:57.825663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.826179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.826618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.827314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:57.827777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:57.828236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:57.952945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.961401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.962835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:57.964018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45d20946-5d9f-4e43-8fb9-09fab3507347 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.149224 Sep 11 05:55:57.965106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1501/2780] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:57 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:58.082161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:58.082775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:58.088685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.089185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.090119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.090805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.091258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.091680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.221513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:58.229622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2889007f-1c19-4014-86b4-afaabd050bbc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151290 Sep 11 05:55:58.230247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1280/2781] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:58 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:58.384207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:58.384745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:58.391533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.392317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.392755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.393438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.393888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.394313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.405826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:58.406447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:58.412795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.413275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.413720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.414421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.414882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.415311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.460826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:58.469274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dbe40735-906d-40fb-9192-7b675e8a774c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088963 Sep 11 05:55:58.469858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1502/2782] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:58.545613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:58.553839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ce3cab4-38a2-41ae-a6cc-1346e5aaa8ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152021 Sep 11 05:55:58.554419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1281/2783] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:58.559190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:58.559910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:58.565818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.566294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.566727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.567535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.568008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.568427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.693684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:58.701889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-857c4377-0603-49e4-8a04-c07798a54c1d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147222 Sep 11 05:55:58.702472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1503/2784] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:58 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:58.990276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:58.990842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:58.997067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.997551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.997995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:58.998689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:58.999148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:58.999576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.128849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.137940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.139387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.140644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f14fb9e-eaa7-4e84-be26-ae0ff6763d6d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154381 Sep 11 05:55:59.141209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1282/2785] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:55:58 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:55:59.253136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:59.253698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:59.259665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.260199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.260639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.261332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.262305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.262732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.389892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.398246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c797581-8e4c-473f-abf8-90160600bd72 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148996 Sep 11 05:55:59.398800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1504/2786] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:59.492195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:59.492849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:59.500026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.500516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.500953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.501640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.502092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.502515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.563686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.573091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff7d0fe9-53d2-4960-84d9-e8552b847992 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084702 Sep 11 05:55:59.573695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1283/2787] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:55:59.578143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:59.578758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:59.584786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.585272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.585712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.586399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.586853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.587279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.716762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.718938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:55:59.725237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:55:59.725850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:55:59.726353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4df1e8b-50c1-429b-b25b-1ddcb384192f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152767 Sep 11 05:55:59.726921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1505/2788] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:55:59.732652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.733138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.733574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.734269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:55:59.734726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:55:59.735501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:55:59.862575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:55:59.870561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b96e39ad-f257-42e9-9dcf-a483a4601da4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149126 Sep 11 05:55:59.871513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1284/2789] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:55:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:00.166654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:00.167264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:00.173459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.173947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.174386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.175071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.175529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.175958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.304381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.313017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.314456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.315613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8bd984f-3f0b-4ea6-8385-3e09f0b62803 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.152953 Sep 11 05:56:00.316227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1506/2790] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:00 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:00.423155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:00.423685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:00.429610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.430089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.430521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.431256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.431707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.432164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.564431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.572777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc59768f-17f2-4a9a-a90e-7e5d0d9247c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154038 Sep 11 05:56:00.573376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1285/2791] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:00.596974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:00.597580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:00.603415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.603893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.604364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.605039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.605510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.605931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.665852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.673944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62e4deb5-5b88-43f6-b9a7-2d27cad402ef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.080755 Sep 11 05:56:00.674434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1507/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:00.750174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:00.750778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:00.756665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.757140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.757577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.758254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.758705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.759123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.885552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:00.894170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:00.894551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8bd5879b-f7d1-4ce8-ba29-7d0608e853fc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148238 Sep 11 05:56:00.894786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:00.895291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1286/2793] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:00.900758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.901246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.901683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:00.902453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:00.902910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:00.903332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.034058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.042236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ea2399d-6e11-407c-a341-b6e5723208be tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152181 Sep 11 05:56:01.043435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1508/2794] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:01.341067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:01.341709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:01.347676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.348202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.348653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.349347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.349806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.350236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.479211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.481468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:01.489044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.490494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.491666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-116d7ab3-3d25-4f2f-9a4d-ff640ab99c3d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155334 Sep 11 05:56:01.492583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1287/2795] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:01 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:01.597256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:01.597815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:01.603702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.604236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.604675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.605877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.606365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.606790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.696877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:01.697500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:01.708978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.709483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.709935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.710643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.711105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.711540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.778287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.786526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a49ee68-3713-494e-8cb8-a273789e4021 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.093747 Sep 11 05:56:01.787098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1288/2796] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:01.816176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:01.824636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bd7e01e-7d32-436f-8041-e11dc8e4374b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.231120 Sep 11 05:56:01.825326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1509/2797] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:01 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:01.918282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:01.919272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:01.925181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.925660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.926093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:01.926778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:01.927227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:01.927646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.057794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.066056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:02.067404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:02.073465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cefc4b59-a081-45c6-999a-e67acd91e03a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.159490 Sep 11 05:56:02.074817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1289/2798] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:02.076210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.076837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.077345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.078133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.078652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.079189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.504324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.513616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ee67318-2225-48a6-a074-ecf6baac3c9b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.451492 Sep 11 05:56:02.514431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1510/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:02.518800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:02.519419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:02.525614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.526099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.526539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.527338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.527946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.528418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.653555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.662050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.663499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.664709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d3255da-1220-4c41-9a4e-58757684a19f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.150892 Sep 11 05:56:02.665272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1290/2800] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:02 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:02.809972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:02.810620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:02.817148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.817636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.818079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.818778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.819244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.819675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.847521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:02.848152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:02.853965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.854445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.854878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.855990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:02.856469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:02.856899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:02.882525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.891547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38ab495e-e9e5-435d-9844-efd6bca600da tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085401 Sep 11 05:56:02.892405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1511/2801] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:02.988379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:02.996651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d433fa44-48ab-42f2-8e7b-516d904d93d2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152876 Sep 11 05:56:02.997217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1291/2802] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:03.097382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:03.098008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:03.104495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.105059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.105597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.106475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.106936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.107369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.235793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.244104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9fab1d2-6718-486e-831a-9c4d49272786 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150739 Sep 11 05:56:03.244677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1512/2803] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:03.536797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:03.537329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:03.544612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.545096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.545537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.546221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.546672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.547093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.674426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.682478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4aa5ba20-34da-4f48-98da-c6173d149d76 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149598 Sep 11 05:56:03.683036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1292/2804] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:03.690700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:03.691311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:03.697317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.697791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.698220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.698985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.699440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.699855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.827236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.835824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.837299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.838449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01851942-d89d-4d5b-a556-6be72db6f3cf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151609 Sep 11 05:56:03.838999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1513/2805] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:03 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:03.914608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:03.915217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:03.921822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.922302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.922740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.923427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:03.923885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:03.924342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:03.988299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:03.996787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e807e58-dcb8-420a-ab95-073d60c59157 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086054 Sep 11 05:56:03.997348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1293/2806] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:04.020186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:04.020800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:04.026697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.028016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.028462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.029148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.029601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.030026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.158001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:04.166140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7890b4d6-a2da-482a-bf15-ca102a1be2e7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150118 Sep 11 05:56:04.166702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1514/2807] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:04 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:04.267914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:04.268581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:04.274462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.274948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.275388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.276113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.276575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.277651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.407022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:04.415174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5356db90-f900-4c58-b56b-d80b677fee54 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151568 Sep 11 05:56:04.415743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1294/2808] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:04.706335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:04.706891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:04.712807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.713289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.713719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.714446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.714979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.715403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.845770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:04.854853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b6a75d3-88a3-4fb1-a355-db68eac59b35 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152459 Sep 11 05:56:04.855429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1515/2809] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:04.864503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:04.865284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:04.873608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.874117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.874562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:04.875274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:04.875839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:04.876386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.009732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.019396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.020733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:05.020881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.021497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:05.022016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b290bae-08fc-498d-8fea-6ee3db6e030c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161978 Sep 11 05:56:05.022569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1295/2810] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:04 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:05.028150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.028639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.029081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.029779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.030236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.030661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.097901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.107446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-465035c0-9c38-4c39-90c0-8871be6179af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.091401 Sep 11 05:56:05.108141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1516/2811] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:05.190413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:05.191006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:05.196916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.197393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.197826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.198507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.199203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.199627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.329325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.337447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74400d03-de19-43f7-8fbc-7004b4423aad tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150942 Sep 11 05:56:05.338003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1296/2812] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:05.438735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:05.439351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:05.445292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.445759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.446193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.446874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.447326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.447750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.576870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:05.585082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4444f761-4ea1-40e1-a67e-6bdea0c90961 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150243 Sep 11 05:56:05.585638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1517/2813] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:05.878782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:05.879319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:05.885671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.886645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.887152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:05.887831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:05.888318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:05.888739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.015052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.023546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07ec4d30-a948-497f-b2df-10f9eba2376a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148698 Sep 11 05:56:06.024143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1297/2814] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:06.047131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:06.047747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:06.054158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.054637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.055075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.055761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.056241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.056684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.134998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:06.135725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:06.143248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.143767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.144234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.144931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.145393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.145820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.188067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.196912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.198363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.199829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60e273aa-a444-4026-a369-b8ffe9c323ec tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157123 Sep 11 05:56:06.200418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1518/2815] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:06 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:06.209101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.218063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea4745ed-9484-464a-9a0d-0622c773e26b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087715 Sep 11 05:56:06.218629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1298/2816] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:06.361042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:06.361658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:06.367486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.367968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.368438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.369127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.369586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.370011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.498414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.506585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d90d230-c3dd-4f81-9016-c6d93bc81413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149418 Sep 11 05:56:06.507140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1519/2817] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:06 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:06.608545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:06.609178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:06.615004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.615483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.615916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.616622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:06.617073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:06.617496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:06.747136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:06.755264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf970ee2-dcc2-49cc-bab8-2859465261af tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150919 Sep 11 05:56:06.755828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1299/2818] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:07.047743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:07.048323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:07.054630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.055108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.055541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.056252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.056704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.057124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.184376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.192557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5fd7f04b-4270-4c5d-b4dd-97436c1c1dbb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149008 Sep 11 05:56:07.193119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1520/2819] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:07.225507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:07.226227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:07.232640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.233124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.233562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.234250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.234707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.235137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.241292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:07.241910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:07.248325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.248819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.249261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.249956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.250416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.250845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.313002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.321069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49ea523c-53ff-436c-a6ba-e96971feaed6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083508 Sep 11 05:56:07.321634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1521/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:07.363212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.372528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.374091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.375253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2e8d668-0191-435c-9ab5-0a6a854ea20d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153673 Sep 11 05:56:07.375837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1300/2821] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:07 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:07.530291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:07.530903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:07.536868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.537344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.537776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.538481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.538930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.539357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.554643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:07.672529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.680788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a59c009b-edd7-41fa-bddd-e8086f52d437 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154675 Sep 11 05:56:07.681341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1522/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:07 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:07.779965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:07.780597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:07.786498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.786973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.787431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.788140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:07.788593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:07.789013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:07.919704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:07.928009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c543897b-c197-4745-9a10-3851c1b390bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152554 Sep 11 05:56:07.928579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1301/2823] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:08.216666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:08.217194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:08.224625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.225105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.225535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.226220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.226671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.227129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.343401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:08.344191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:08.350866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.351507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.352073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.352847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.353383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.353728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.353864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.362173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90d75cee-26c2-431b-b065-ef073aa758da tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149483 Sep 11 05:56:08.362738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1523/2824] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:08.400431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:08.401051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:08.407756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.408281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.408752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.409450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.409907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.410336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.416372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.424556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff5e8a09-0944-41fb-9a76-98328ef6d671 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085717 Sep 11 05:56:08.425128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1302/2825] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:08.542368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.550898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.552386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.553556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-828360dc-1bb2-4120-a22f-ca1ef0bca826 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156976 Sep 11 05:56:08.554110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1524/2826] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:08 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:08.704685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:08.705293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:08.711145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.711618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.712073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.712753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.713204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.713628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.843577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:08.851860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb568471-3b8c-4189-b841-d967f62df5f5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151072 Sep 11 05:56:08.852451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1303/2827] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:08.950658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:08.951305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:08.957208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.957702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.958143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:08.958834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:08.959298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:08.959729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.088765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.097228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57a89304-3391-4959-b3f7-b285eb379b6e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150453 Sep 11 05:56:09.097815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1525/2828] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:09.386738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:09.387510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:09.394224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.394713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.395154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.395851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.396337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.396769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.411397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:09.450053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:09.450810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:09.457347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.457826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.458259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.458951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.459402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.459827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.522014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.529920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.530339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a133c62-a9ef-4be0-8c0a-fdc4f1675948 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084779 Sep 11 05:56:09.530910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1526/2829] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:09.538033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3bf80e2-3db4-44cb-bd01-fe163a28c97d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155860 Sep 11 05:56:09.538777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1304/2830] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:09.579115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:09.580033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:09.586801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.587389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.587984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.589013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.589715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.590381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.726136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.734747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.736226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:09.737402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7617730a-6ce9-4016-8a6d-330b73f24d55 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162778 Sep 11 05:56:09.737962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1527/2831] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:09 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:09.874656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:09.875269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:09.881316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.881801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.882239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:09.882929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:09.883383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:09.883809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.013430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.021891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-492a82d4-099f-4df0-9d7b-3d4599892639 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151093 Sep 11 05:56:10.022468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1305/2832] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:10.121668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:10.122292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:10.128197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.128688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.129127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.129817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.130278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.130713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.254826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.263884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-394535c9-4572-4767-b07e-81bc46bfc1cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.146550 Sep 11 05:56:10.264479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1528/2833] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:10.553604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:10.554166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:10.560855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.561338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.561713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:10.562138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.562338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:10.562461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.562888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.563310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.569886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.570378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.570820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.571516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.571977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.572431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.627651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.635789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef18fda8-3ade-4813-89e9-64eac9e83744 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086161 Sep 11 05:56:10.636377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1306/2834] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:10.701472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.709742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c201ce8b-68af-42ee-abe2-6081a801a68f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152188 Sep 11 05:56:10.710292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1529/2835] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:10 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:10.763583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:10.764216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:10.770345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.770821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.771254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.771933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:10.772410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:10.772831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:10.902007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.910567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.912020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:10.913219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2753c648-ff35-4be6-ad5b-9fc81c78303d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154448 Sep 11 05:56:10.913785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1307/2836] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:10 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:11.045254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:11.045879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:11.051810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.052327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.052771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.053457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.053913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.054343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.186303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:11.194954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cb6f1c4-8284-4f08-be51-382e20770276 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154236 Sep 11 05:56:11.195528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1530/2837] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:11 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:11.287136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:11.287742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:11.293907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.294381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.294814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.295497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.295943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.296388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.422164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:11.430254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d20b3a4e-0ff4-4b4d-945f-9451dee05a93 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.146953 Sep 11 05:56:11.430813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1308/2838] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:11.659339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:11.659884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:11.666332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.666818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.667259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.668074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.668533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.668962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.730162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:11.732500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:11.733116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:11.735430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:11.739010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08dce8ee-5ba0-474c-849a-7f73d6e132f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083535 Sep 11 05:56:11.739588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1531/2839] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:11.740973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.741461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.741904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.742604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.743059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.743485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.873812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:11.881974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c89a7b0-7491-4fd4-94ab-7aa79a1737a0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153663 Sep 11 05:56:11.882547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1309/2840] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:11.939504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:11.940065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:11.945913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.946410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.946838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:11.947513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:11.947961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:11.948401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.079141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.087792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.089250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.090473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4b1e6fa-e919-4cae-ae20-5c0d11b95dab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154940 Sep 11 05:56:12.091020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1532/2841] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:11 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:12.218859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:12.219398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:12.225320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.225803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.226243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.226928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.227382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.227809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.354149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.362822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67de2dad-7282-4ef1-99aa-918cfa88e648 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148549 Sep 11 05:56:12.363393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1310/2842] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:12.454061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:12.454680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:12.456537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:12.462040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.462526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.462967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.463657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.464174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.464606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.592782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.601166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ea35bcd-ddad-41e8-af3f-fbc5b238aab3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151153 Sep 11 05:56:12.601733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1533/2843] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:12.762436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:12.763053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:12.769747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.770218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.770660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.771354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.771815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.772275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.833691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:12.842416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3865e3a2-55ec-43d0-b9d3-e7dc27067255 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084413 Sep 11 05:56:12.842986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1311/2844] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:12.905990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:12.906630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:12.913030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.913515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.913957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:12.914650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:12.915106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:12.915536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.043218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.051533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca6290b0-23db-4acf-b2ab-1010b9b0781c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150010 Sep 11 05:56:13.052308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1534/2845] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:13.116346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:13.116976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:13.123410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.123890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.124356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.125046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.125503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.125931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.258428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.268202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.269663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.270833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9dd73e1-42f8-4977-86b9-2aaeba2609e3 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158955 Sep 11 05:56:13.271390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1312/2846] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:13 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:13.385444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:13.385984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:13.392201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.392679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.393111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.393790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.394240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.394659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.523542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.532251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98c6b338-d431-45a7-8581-829b0746efce tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150706 Sep 11 05:56:13.532806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1535/2847] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:13.623694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:13.624335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:13.630486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.630975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.631417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.632146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.632607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.633041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.761636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.770840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8473057-1f63-4580-a8c5-73c97754df98 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151021 Sep 11 05:56:13.771444 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1313/2848] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:13.864641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:13.865266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:13.871789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.872363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.872809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.873509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:13.873972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:13.874404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:13.935558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:13.943768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b8218f4-d5cc-4299-8abc-a8e333d365d3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Sep 11 05:56:13.944358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1536/2849] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:14.074814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:14.075425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:14.081337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.081848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.082291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.082984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.083445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.083874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.211834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.220163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9156464b-7c2c-4a17-acb1-e60da5738a81 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149279 Sep 11 05:56:14.220733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1314/2850] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:14.296404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:14.297022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:14.302907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.303397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.303838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.304562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.305025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.305458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.432602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.441168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.442607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.443769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c7ad7c3-87ce-4c54-825d-981330a6ef21 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.151863 Sep 11 05:56:14.444372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1537/2851] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:14 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:14.555291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:14.555901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:14.562006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.562496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.562931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.563619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.564103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.564531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.689169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.697525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b5aa0e8-c35c-493c-8122-cbda23849d6a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.146105 Sep 11 05:56:14.698092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1315/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:14.793729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:14.794674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:14.800691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.801186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.801623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.802313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.802770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.803196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.935219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:14.943462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47e1bb77-ad0a-4b8a-be81-cad74a271312 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154084 Sep 11 05:56:14.944089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1538/2853] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:14.966865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:14.967473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:14.974576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.975059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.975505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:14.976224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:14.976683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:14.977112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.040988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.049712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a22dce49-4e73-4bf2-8f55-1b1443e96fd9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086869 Sep 11 05:56:15.050284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1316/2854] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:15.243945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:15.244586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:15.251078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.251554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.251984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.252685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.253135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.253557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.256078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:15.382558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.392349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9712c87-50ff-4972-a2f9-9d2b392d6321 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151912 Sep 11 05:56:15.392923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1539/2855] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:15.468636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:15.469176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:15.475053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.475535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.475978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.476713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.477168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.477596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.720872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:15.721458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:15.727598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.728114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.728551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.729251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.729703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.730132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.829484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.838270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.839717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.840996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07102bab-9274-42ea-9bbd-787a63ae9932 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.376492 Sep 11 05:56:15.841557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1317/2856] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:15 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:15.870885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:15.879719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb7b9748-ed10-4903-9a9f-2f156a47fbf4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162972 Sep 11 05:56:15.880303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1540/2857] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:15.967225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:15.967827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:15.974025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.974558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.975014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:15.975698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:15.976189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:15.976609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.073311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:16.074132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:16.080650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.081145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.081587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.082288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.082749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.083183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.103012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:16.112181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df904ce7-b71a-446a-ba69-9e36e2de075c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149356 Sep 11 05:56:16.112940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1318/2858] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:16.146047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:16.154724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f99a4753-7aa8-42aa-9191-cc0e1281ee83 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085274 Sep 11 05:56:16.155287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1541/2859] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:16.414629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:16.415247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:16.421348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.421835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.422275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.422992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.423461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.423887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.551712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:16.560166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-344c523b-1d51-4105-bbce-066d5254a0b3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149303 Sep 11 05:56:16.560740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1319/2860] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:16.867086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:16.867734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:16.874258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.874755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.875194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.875897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.876388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.877095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.903190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:16.903803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:16.910449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.910934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.911384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:16.912120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:16.912583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:16.913205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.031518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.044811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.047117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.048401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09f4b6e0-d498-44d1-b9a9-8e6f0857e37b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.185412 Sep 11 05:56:17.049182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1542/2861] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:17.063171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.074113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9ca9765-ebd2-4217-b3d9-07e9da336f07 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.174964 Sep 11 05:56:17.076138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1320/2862] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:17.136080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:17.136912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:17.143803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.144326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.144779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.145478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.145944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.146374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.177992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:17.178612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:17.185514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.186255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.186949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.187862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.188347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.188817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.212186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:17.260834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.271261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb8db283-c23a-447e-8951-10b5b680b5b2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.096922 Sep 11 05:56:17.272086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1321/2863] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:17.320050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.329298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cf6ee1a-cceb-416a-a18a-b249cb50581b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.197101 Sep 11 05:56:17.329877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1543/2864] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:17.584060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:17.584598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:17.590706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.591185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.591625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.592352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:17.592807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:17.593228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:17.736818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:17.745196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41e1045f-91a9-4cdc-9b9b-3b7d171e0ec0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.165141 Sep 11 05:56:17.745758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1322/2865] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:17 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:18.078706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:18.079318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:18.085347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.085830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.086267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.086956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.087408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.087833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.099647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:18.100306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:18.107445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.107923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.108381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.109069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.109518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.109939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.220180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.228742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.230186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.231933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24a6679a-7591-4f2d-bdba-df2028527be6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157306 Sep 11 05:56:18.232521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1544/2866] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:18 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:18.239019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.247077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59950d16-3bb0-4f6d-80cc-566a92b9d55c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151246 Sep 11 05:56:18.247636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1323/2867] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:18.299273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:18.299894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:18.305868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.306359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.306800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.307495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.307955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.308421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.352942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:18.353472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:18.360298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.360784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.361218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.361937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.362388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.362811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.369711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.377934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12e41efa-9492-4ddd-a69a-956622369cc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082417 Sep 11 05:56:18.378499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1545/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:18.493157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.501453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d5b5627-b292-45a3-b757-51a011eb5363 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152508 Sep 11 05:56:18.502036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1324/2869] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:18.769114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:18.769755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:18.775577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.776087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.776525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.777208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:18.777802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:18.778383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:18.909341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:18.917487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d3c4193-859d-4e9f-afba-e111e9b50b02 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152545 Sep 11 05:56:18.918639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1546/2870] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:19.257685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:19.258301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:19.265644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.266135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.266577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.267533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.267989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.268455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.270297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:19.270960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:19.277282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.277962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.278429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.279135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.279597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.280052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.400954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.410479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.410968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.411928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.413168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15398be1-c040-46d8-90a4-42bedece0e61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.159333 Sep 11 05:56:19.413767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1325/2871] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:19 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:19.418903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:19.419517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:19.420729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e5552a7-527e-4cc8-8002-49d0499fbc76 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154452 Sep 11 05:56:19.421391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1547/2872] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:19 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:19.425477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.425967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.426409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.427106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.427579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.428008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.488734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.496872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c02d1bec-7d4a-4bfa-bdc3-e0a62460c12e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082007 Sep 11 05:56:19.497440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1326/2873] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:19.525222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:19.525862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:19.532652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.533136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.533572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.534263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.534714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.535139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.664223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:19.672479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98fc7293-f02a-467b-aff8-9601373dcb6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151182 Sep 11 05:56:19.673042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1548/2874] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:19.942101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:19.942713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:19.948677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.949161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.950292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:19.950986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:19.951447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:19.951877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.079366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.087403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18dc1930-79d2-4de0-9a88-948573f7f344 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149138 Sep 11 05:56:20.087967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1327/2875] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:20.438668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:20.439288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:20.443483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:20.444165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:20.445748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.446233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.446673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.447365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.447818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.448268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.450510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.450988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.451424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.452139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.452594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.453018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.580714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.580961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.589106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dad8adf6-1a79-47ad-b589-909a3063548c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149386 Sep 11 05:56:20.589725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.590401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1328/2876] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:20.592184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.593362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e54e73e-2b10-4ccc-a82a-be7e0c0c8aba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.158654 Sep 11 05:56:20.593943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1549/2877] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:20 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:20.603177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:20.603868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:20.610162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.610621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.611056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.611737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.612212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.612634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.673247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.681275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-abc21d5d-a2f8-48ad-9b4a-e1ba3ccdc759 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081897 Sep 11 05:56:20.681821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1329/2878] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:20.696301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:20.697073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:20.704115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.704601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.705034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.705722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:20.706171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:20.706591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:20.837355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:20.845661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4df33c38-552c-4d0b-b398-cc500b385994 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153125 Sep 11 05:56:20.846221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1550/2879] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:21.111658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:21.112296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:21.118190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.118666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.119097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.119778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.120257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.120680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.250908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.259014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22903920-0f9c-4f4f-8aef-b8bc3c4a7acc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151166 Sep 11 05:56:21.259573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1330/2880] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:21.612811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:21.613505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:21.618553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:21.619162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:21.619962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.620469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.620900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.621925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.622379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.622802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.625244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.625726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.626166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.626856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.627323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.627737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.756043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.758049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.765614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.767332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.767925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c2d16b2-19bb-41f6-b3ab-35c415ce2461 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158896 Sep 11 05:56:21.768793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88efda6f-de30-45e8-a02a-3f205c922ffd tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153898 Sep 11 05:56:21.769454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1551/2881] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:21.774036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:21.774645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:21.778035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1331/2882] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:21 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:21.784922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.785415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.785864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.786564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.787016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.787440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.851101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:21.859338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cfae68b-620b-48b2-b461-d8defe75bb7e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088889 Sep 11 05:56:21.859896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1552/2883] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:21.869045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:21.869590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:21.875702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.876224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.876666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:21.877351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:21.877808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:21.878236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.009025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.018172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7968182a-dd47-4450-a16f-cde96ceecefe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152920 Sep 11 05:56:22.018744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1332/2884] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:22.282706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:22.283237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:22.289256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.289772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.290211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.290895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.291348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.291770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.422168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.430273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e999d850-68a8-47e0-b21f-fa458d58d8df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151478 Sep 11 05:56:22.430831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1553/2885] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:22.791565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:22.792323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:22.794786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:22.795402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:22.799984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.800498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.800939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.801630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.801861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.802079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.802360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.802765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.802892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.803484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.803937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.804395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.935170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.936162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.943959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.944311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-700a3150-68f3-4282-891f-3ad2c779d8fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156737 Sep 11 05:56:22.944861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1333/2886] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:22.945472 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:22.946644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8d9db41-b90b-457f-aa9d-88f4e92c9308 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156456 Sep 11 05:56:22.951452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1554/2887] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:22 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:22.951617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:22.951617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:22.955899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.956439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.956877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:22.957564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:22.958016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:22.958437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.020461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:23.029583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d99f913-f841-4452-86b8-f8d0c590b39a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083792 Sep 11 05:56:23.030142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1334/2888] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:23.041264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:23.041941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:23.047780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.048306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.048746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.049437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.049891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.050340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.175606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:23.177840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:23.185354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3d6f2a3-54dd-4d19-9150-c1ffb472ebfe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147920 Sep 11 05:56:23.185925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1555/2889] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:23.454866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:23.455475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:23.461401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.461887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.462326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.463015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.463469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.463891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.593565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:23.601729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-571c1635-e905-442f-9b7d-ed91d159e669 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150684 Sep 11 05:56:23.602338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1335/2890] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:23.967222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:23.967835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:23.971202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:23.971805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:23.974394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.974884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.975322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.976039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.976499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.976934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.978044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.978519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.978951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:23.979623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:23.980878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:23.981501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.109053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.110029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.117555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4ee3c66-e3ee-4701-9d84-9dc1b18b8dc6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154958 Sep 11 05:56:24.118461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.118639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1556/2891] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:24.120083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.121292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0ac789a-1d33-4693-825c-93170009844d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.153857 Sep 11 05:56:24.132187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1336/2892] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:23 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:24.132372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:24.132372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:24.132372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.132372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.132784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.132784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.132784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.132784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.193116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.201784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-784b48bd-763b-448a-8b79-88074478e05c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082122 Sep 11 05:56:24.202351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1557/2893] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:24.210597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:24.211291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:24.217247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.217729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.218171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.218856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.219313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.219733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.348655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.350804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:24.357872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-045d8c98-091f-4093-86d2-e01fba44ff1f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151037 Sep 11 05:56:24.358439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1337/2894] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:24.625529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:24.626062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:24.631894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.632403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.632838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.633608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:24.634057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:24.634478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:24.765395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:24.773820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-259220c8-2604-41d6-bd25-fa01973ec908 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152872 Sep 11 05:56:24.774375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1558/2895] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:25.141632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:25.142554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:25.148381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:25.149036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:25.151527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.152022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.153097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.153997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.154454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.154882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.156188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.156685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.157263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.157827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.158287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.158724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.286842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.294243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.295923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe4d3a9c-5c2b-47a8-bf73-682bc786dc5b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159348 Sep 11 05:56:25.296544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1338/2896] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:25.301366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:25.301973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:25.302949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.304525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.305583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf2debd2-75a4-4b09-835f-3fd21b7c7643 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161186 Sep 11 05:56:25.306396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1559/2897] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:25 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:25.308532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.309547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.310144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.310844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.311298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.311725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.372537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.380658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8302966-3f04-41b5-93cc-92b14a967bd7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083153 Sep 11 05:56:25.381226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1339/2898] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:25.381402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:25.382020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:25.388209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.388700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.389140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.389835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.390294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.390726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.521804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.530796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3af3887a-1419-43b4-9a68-f5bd11a3598c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153170 Sep 11 05:56:25.531369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1560/2899] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:25.797893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:25.798427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:25.804496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.804975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.805410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.806388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:25.806512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:25.806935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:25.936947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:25.944940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3df68dbc-6952-429c-9aa8-69d3e7517377 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151058 Sep 11 05:56:25.945503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1340/2900] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:26.319452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:26.320192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:26.327315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.327803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.328274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.328972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.329434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.329859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.330538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:26.331183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:26.337481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.337961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.338400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.339094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.339555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.340154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.463511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.469414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.472637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55f7ce63-f0fa-4e4f-b157-60d37f8b88d4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157012 Sep 11 05:56:26.473219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1561/2901] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:26.477629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:26.478238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:26.478451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.480090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.482392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3a2e0db-0607-4a07-8ca6-693bf6d72d1a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.155715 Sep 11 05:56:26.483198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1341/2902] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:26 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:26.484794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.485284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.485727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.486429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.486888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.487318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.547963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.553861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:26.554550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:26.556439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6639dc18-fc2d-48a5-a6f4-dffef6ded438 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082223 Sep 11 05:56:26.557005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1562/2903] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:26.560934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.561413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.561844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.562529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.562978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.563395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.689264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:26.697497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49b7531d-95ab-4e2e-981c-98c78a12d691 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147366 Sep 11 05:56:26.698054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1342/2904] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:26.969025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:26.969568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:26.975529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.976046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.976493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:26.977184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:26.977642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:26.978072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.103372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.111625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d03094f-bd58-49d2-b528-5e97d706ac6a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147391 Sep 11 05:56:27.112227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1563/2905] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:27.496568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:27.497329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:27.503696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.504212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.504655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.505349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.505804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.506232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.506611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:27.507217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:27.514464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.514927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.515362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.516068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.516526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.517212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.640613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.649050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e095df9-7cd8-42d7-81a7-f8b39b7ce557 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156917 Sep 11 05:56:27.649628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1343/2906] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:27.650163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.657251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:27.657844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:27.659966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.661549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.662804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c6d132a-ba15-4cf3-adbb-8fe3cb425a2e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160097 Sep 11 05:56:27.663549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1564/2907] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:27 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:27.663887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.664424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.664957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.665666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.666119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.666542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.721094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:27.721708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:27.727322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.728263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.728811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.729311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.730071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:27.731324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:27.731823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:27.737778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d93e0893-602f-433e-aa02-90959a2c433c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085172 Sep 11 05:56:27.738355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1344/2908] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:27.861581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:27.869689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04823896-3a91-4475-ab52-a3f65a171360 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152421 Sep 11 05:56:27.870247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1565/2909] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:28.134872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:28.135484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:28.141365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.142120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.142572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.143256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.143710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.144169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.274867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.283684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e0b5df41-adc9-4091-8c20-fd608a9e9801 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152655 Sep 11 05:56:28.284280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1345/2910] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:28.672972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:28.673584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:28.679816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.680325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.680758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.681434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.681883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.682304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.689406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:28.690028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:28.696625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.697108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.697542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.698263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.698749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.699973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.827836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.833236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.836402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4fd393b-76c7-43ac-a6f7-277ee5987694 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.167215 Sep 11 05:56:28.837097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1566/2911] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:28.842891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:28.843497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:28.847911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.849162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.849643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.849970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.850098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.850811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.851268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.851549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08fb7677-a71c-4031-8fd3-968947500f74 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.166123 Sep 11 05:56:28.851678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.856803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1346/2912] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:28 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:28.893884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:28.894509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:28.900477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.900964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.901408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.902637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:28.903229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:28.903659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:28.914405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:28.923275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-795e8ac4-4d5c-44ad-bf16-0f21887ae46e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085034 Sep 11 05:56:28.923845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1567/2913] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:29.031771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:29.039893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0f57c41-c201-4b93-be72-03930b039dfa tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150272 Sep 11 05:56:29.040497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1347/2914] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:29.306898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:29.307440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:29.313739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.314219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.314653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:29.315334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.315788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.316236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:29.444698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:29.453464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e585569d-c5ea-4a1f-957e-70eb2c3d522b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150485 Sep 11 05:56:29.454029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1568/2915] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:29.861131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:29.861739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:29.868166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.868646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.869085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:29.869763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.870210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.870632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:29.877153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:29.877766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:29.884158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.884640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.885078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:29.885764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:29.886215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:29.887164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.004980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.013623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b9b8556-8711-464a-9d2c-6a09f6f69375 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156365 Sep 11 05:56:30.014191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1348/2916] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:30.018878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:30.019702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:30.023318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.025434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.026095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.026542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.028451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.028913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.029343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.033797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.035340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.036539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5bb8b45-4a1e-424f-a87e-94518b4431e2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163211 Sep 11 05:56:30.037087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1569/2917] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:29 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:30.063195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:30.063727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:30.069549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.070043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.070494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.071192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.071645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.072091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.091364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.099438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc78a8ed-604b-4786-b462-fd683dbce05f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084261 Sep 11 05:56:30.100017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1349/2918] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:30.200885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.208983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8a4b40b-f1af-409a-aa8c-2c3d63c4fde5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150283 Sep 11 05:56:30.209541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1570/2919] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:30.476307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:30.476930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:30.483178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.483737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.484395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.485029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:30.485553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:30.486042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:30.615078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:30.624231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e7c423b-63ec-4fd4-8f0a-7119a9d26fd9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151716 Sep 11 05:56:30.624795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1350/2920] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:30 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:31.037687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:31.038282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:31.045494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.045972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.046404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.047088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.047538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.047960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.061943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:31.062464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:31.068509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.068993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.069431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.070120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.070577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.071000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.182437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.191530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7b97772-843c-48b2-9849-ce7a2cb3a0e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157786 Sep 11 05:56:31.192108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1571/2921] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:31 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:31.196564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:31.197174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:31.203777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.204299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.204743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.205447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.206018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.206457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.210931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.219603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.221062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.222233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0cbe0a94-b651-4418-80e0-c0bb7a41884f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.164243 Sep 11 05:56:31.222796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1351/2922] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:31 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:31.226448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:31.232509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:31.233123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:31.239291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.239782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.240252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.240948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.241403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.241857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.277354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.285957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c26e845-c365-4d25-ba0c-f4c826613250 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.092816 Sep 11 05:56:31.286542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1572/2923] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:31.369389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.378297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94f8a86d-8f7e-401e-8c9d-a2a6bce627b2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149652 Sep 11 05:56:31.378850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1352/2924] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:31.647190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:31.647730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:31.654574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.655057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.655494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.656227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:31.656715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:31.657161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:31.784841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:31.793899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32819b13-1d3b-4dcc-b65c-7fc2fd052802 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150570 Sep 11 05:56:31.794509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1573/2925] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:32.216734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:32.217352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:32.223732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.224247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.224692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.225388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.225873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.226302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.247910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:32.248557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:32.255189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.255676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.256143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.256847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.257304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.257727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.362093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.370271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1847d356-7018-40b4-99d3-826b8b05a2ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158127 Sep 11 05:56:32.370914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1353/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:32.375511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:32.376627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:32.381697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.382187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.382624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.383683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.383823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.384205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.394757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.399846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:32.405036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.406519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.407703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61045573-20f1-40a9-8f2a-a73eb6d2a92a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163734 Sep 11 05:56:32.408293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1574/2927] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:32 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:32.412693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:32.413302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:32.419429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.419912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.420372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.421067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.421519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.421946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.448993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.457912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec4762dc-a7d2-4113-a767-77b1b6fb8b49 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085897 Sep 11 05:56:32.458481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1354/2928] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:32.552561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.561494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4937422a-a7af-4ea5-86a6-e85400c14ad4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152252 Sep 11 05:56:32.562058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1575/2929] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:32.817145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:32.817751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:32.823738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.824752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.825186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.825870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:32.826323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:32.826738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:32.951015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:32.959123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5c94c047-4a88-4ef2-8c7f-affa9f9088c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.145869 Sep 11 05:56:32.959681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1355/2930] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:33.394929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:33.395539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:33.401892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.402706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.403142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.403826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.404312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.404739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.435168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:33.435774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:33.442220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.442694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.443127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.443812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.444288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.444853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.536247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.545121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca440e26-90c1-4899-a73e-93072a993508 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154301 Sep 11 05:56:33.545759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1576/2931] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:33.550164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:33.550774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:33.557137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.557629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.558073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.559362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.559830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.560277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.582003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.591011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.592486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.593699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad3c321e-42d8-4675-b114-0676c5c1f5da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163532 Sep 11 05:56:33.594284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1356/2932] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:33 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:33.598765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:33.599383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:33.605729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.606196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.606639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.607345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.607803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.608276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.622530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.630618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97f97df2-649e-49cc-8a91-ba9b6dea81bb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083917 Sep 11 05:56:33.631374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1577/2933] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:33.735725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:33.743890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0a0de20-964c-4de4-891b-c7f278656939 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148670 Sep 11 05:56:33.744483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1357/2934] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:33.982997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:33.983669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:33.989537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.990020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.990456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:33.991142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:33.991595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:33.992048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.117887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.126594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ee534f4-7ceb-4fc6-b682-f007876e7a4b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147627 Sep 11 05:56:34.127157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1578/2935] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:34.568953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:34.569546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:34.576735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.577161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.577596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.578283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.578740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.579162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.618535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:34.619148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:34.625846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.626335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.626768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.627503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.627958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.628412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.713067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.721764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d09129a8-2060-4c0c-8528-55ed39382498 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156623 Sep 11 05:56:34.722331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1358/2936] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:34.726882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:34.727477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:34.729214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:34.734697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.735178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.735616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.736344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.736786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.737302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.765340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.774478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.776030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.777431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec50c896-aff0-462a-b598-8205fa9213d7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.162567 Sep 11 05:56:34.777994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1579/2937] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:34 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:34.787261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:34.787969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:34.794158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.794737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.795182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.795895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:34.796402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:34.796812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:34.804332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.813393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fc11328-b250-4e08-b2c9-662d7c6c0b6e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090056 Sep 11 05:56:34.813969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1359/2938] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:34.926191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:34.934516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1b1782c-b0a9-4344-80e5-3c78836d8af4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151037 Sep 11 05:56:34.935076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1580/2939] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:35.150328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:35.150878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:35.157456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.157935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.158368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.159048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.159508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.159931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.288644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.296806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e5d5740-e704-44ae-be57-50e999a840c5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150414 Sep 11 05:56:35.297366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1360/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:35.744534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:35.745141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:35.751900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.752409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.752847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.753527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.753977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.754402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.802592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:35.803119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:35.810356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.810907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.811408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.812208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.812736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.813243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.884740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.894122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43b3b2ad-3362-4c56-bb60-5576f30c177f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153305 Sep 11 05:56:35.894702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1581/2941] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:35.899134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:35.899748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:35.906415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.906905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.907338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.908059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.908536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.908963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.947503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.957249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.958698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.959888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94e603d0-4f6b-4ed6-a7e2-3e9957a582a7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.161293 Sep 11 05:56:35.960482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1361/2942] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:35 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:35.964828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:35.965609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:35.972225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.972728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.973160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.973854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:35.973991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:35.974309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:35.974730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:35.983077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf34795b-827c-4ea7-b338-914bb1f4229b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087396 Sep 11 05:56:35.983650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1582/2943] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:36.102201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:36.110719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9aa11bc-640d-48e3-b59d-df2781c8aee3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149311 Sep 11 05:56:36.111281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1362/2944] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:36.320053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:36.320672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:36.322519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:36.328913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.329401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.329867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:36.330580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.331029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.331480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:36.458179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:36.466322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8703bf86-6b27-4720-83eb-fc969fbfd6f0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150167 Sep 11 05:56:36.467072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1583/2945] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:36.918553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:36.919209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:36.925574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.926090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.926532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:36.927222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.927677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.928132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:36.985934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:36.986527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:36.992832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.993318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.993757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:36.994451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:36.994905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:36.995335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.060308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.073196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a04b9cd0-ca52-4434-a1c7-b2d711433317 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159223 Sep 11 05:56:37.074108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1363/2946] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:36 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:37.085457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:37.086155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:37.092986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.093475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.093944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.094643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.095104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.095532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.128097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.137317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.138752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.139921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4104d6c1-b16e-4f6a-9415-256fa42dbdb7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157955 Sep 11 05:56:37.140511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1584/2947] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:36 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:37.145039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:37.145643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:37.151506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.152535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.153042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.153917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.154367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.154788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.157614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.165734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6206b95-2ca7-48dc-8f63-5b744f5816e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084023 Sep 11 05:56:37.166300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1364/2948] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:37.287728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.296153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b262652-06bb-46d6-ab8e-4df926acfd3b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154635 Sep 11 05:56:37.296756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1585/2949] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:37.489057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:37.489693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:37.495569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.496305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.496740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.497420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:37.497869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:37.498285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:37.627269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:37.635503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5cac5dfa-4adc-429e-90c2-6f7f36581b41 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150244 Sep 11 05:56:37.636084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1365/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:37 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:38.096365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:38.096990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:38.103423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.103901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.104363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.105613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.106163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.106685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.166754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:38.167349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:38.174349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.174839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.175282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.175974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.176462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.176896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.237438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.245668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd5f44d8-4778-4ad0-975d-797fde80c793 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153032 Sep 11 05:56:38.246758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1586/2951] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:38 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:38.251226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:38.251875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:38.258394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.258918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.259362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.260082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.260544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.260973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.311402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.320260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.321764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.322944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29268fa8-4663-4a6c-8e6a-6d4a17818da5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.160200 Sep 11 05:56:38.323506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1366/2952] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:38 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:38.326954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.328219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:38.328825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:38.334688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.335179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.335620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.336347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.336802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.337231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.339111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b576a406-d066-4c55-9926-c8487a1a3593 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.091368 Sep 11 05:56:38.340229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1587/2953] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:38.466284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.474416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f4c9e80-29e9-4586-8583-ef1a8e690123 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149840 Sep 11 05:56:38.474984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1367/2954] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:38.660386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:38.661001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:38.666959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.667504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.668528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.669336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:38.669793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:38.670225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:38.799431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:38.807801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c0ce797-b46e-464b-ad85-0737fd9d131f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151274 Sep 11 05:56:38.808506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1588/2955] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:39.269703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:39.270308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:39.276751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.277219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.277648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.278333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.278784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.279230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.348361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:39.349007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:39.356009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.356518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.356961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.357765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.358226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.358655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.361742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:39.454968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 05:56:39.455174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 05:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 (ip 10.222.0.33) !!! Sep 11 05:56:39.495187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.504839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.506313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.507487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3844d97-83ce-4a6a-aa67-c0b736a3eeef tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.163257 Sep 11 05:56:39.508092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1589/2956] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:39 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:39.513222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:39.513826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:39.519851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.520379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.521311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.521563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.522062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.522492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.574040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.582310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80563536-280f-40cd-be13-248b68bed386 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.316838 Sep 11 05:56:39.582877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1368/2957] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:39.587336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.587524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:39.588124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:39.593870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.594349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.594780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.595480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.595917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.596172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26f7bc77-aa01-4cb7-b05f-46691d727be4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087074 Sep 11 05:56:39.596378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.596932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1590/2958] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:39.725770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.734353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af4f5c5d-613a-42a5-b475-7e811a298829 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150525 Sep 11 05:56:39.734883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1369/2959] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:39.831228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:39.831839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:39.837701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.838203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.838614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.839311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:39.840097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:39.840534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:39.972574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:39.981215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8807c1df-a527-4433-b226-690d696f867f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153759 Sep 11 05:56:39.981724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1591/2960] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:40.533725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:40.534331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:40.540637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.541114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.541549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.542226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.543465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.544091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.612483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:40.613224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:40.620311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.620645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.621627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.622334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.622793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.623223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.672871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.681388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.682808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.684405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e7de2ee-628e-4180-b488-df0454eb7543 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154567 Sep 11 05:56:40.684969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1370/2961] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:40 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:40.689376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:40.689973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:40.695805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.696322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.696765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.697448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.697899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.698320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.702766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:40.754578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.763474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e4adced-e3b7-426c-b3fa-c32fd9481d9b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154847 Sep 11 05:56:40.764281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1592/2962] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:40.766395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.768899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:40.769504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:40.774966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3739d8fc-9e99-44f0-9911-645d042c1df5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089049 Sep 11 05:56:40.775245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.775704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.775856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1371/2963] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:40.776197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.777416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:40.778179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:40.778809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:40.911663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:40.920120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e354b9bf-cfd7-413c-893d-f6a6a2bd22ce tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155070 Sep 11 05:56:40.920681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1593/2964] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:41.005708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:41.006249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:41.012803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.013313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.013750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.014440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.014894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.015323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.143488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.151625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12675503-e79e-4431-9a54-5336fa9ea9ba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149856 Sep 11 05:56:41.152422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1372/2965] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:41.709385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:41.709993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:41.716603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.717079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.717523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.718209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.718663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.719091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.798852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:41.799464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:41.806507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.806986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.807451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.808797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.809256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.809679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.849453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.858983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.860546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.861790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af1907dd-bac6-4653-8753-35c0c46777c6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.156403 Sep 11 05:56:41.862435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1594/2966] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:41 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:41.866873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:41.867539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:41.874176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.874806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.875316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.876133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.876675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.877172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.939747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.942672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:41.948233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58172fc2-6f40-4216-a187-a3eefed60a7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084709 Sep 11 05:56:41.948850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1595/2967] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:41.951043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81ae9621-bb72-4c23-aaac-6791b3f1dd8b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156026 Sep 11 05:56:41.951763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1373/2968] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:41.953571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:41.954198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:41.960187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.960622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.961069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:41.961764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:41.962225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:41.962656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.093492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:42.101769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01164028-5cea-44ef-b132-858d1a39412a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151793 Sep 11 05:56:42.102335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1596/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:42.174780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:42.175388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:42.181213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.181695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.182133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.182821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.183773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.184237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.312577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:42.320653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0f25604-c9c8-4bcd-b9a0-6806a490a9f8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149763 Sep 11 05:56:42.321211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1374/2970] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:42.887391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:42.887946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:42.894636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.895118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.895552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.896260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.896713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.897132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.971411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:42.972098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:42.978670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.979166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.979608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:42.980522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:42.980985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:42.981448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.026086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.034952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.036423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.037603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-425934aa-64dd-439e-bea1-ea3167a7dfee tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.154803 Sep 11 05:56:43.038166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1597/2971] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:42 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:43.042553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:43.043344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:43.049074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.049267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.049562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.049997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.050687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.051143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.051569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.058482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-154fa128-ac1a-447b-97fe-54303304ad86 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090445 Sep 11 05:56:43.059077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1375/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:43.126039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:43.126661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:43.132466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.132959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.133478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.134082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.134543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.134972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.184749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.193002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-994d63bd-22c8-4c53-bf0f-4f5649ff8a98 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153893 Sep 11 05:56:43.193813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1598/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:43 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:43.268971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.279435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d498e47-5877-425e-a3b3-4c5373ce5052 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157312 Sep 11 05:56:43.280009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1376/2974] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:43.344323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:43.344946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:43.350837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.351324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.351762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.352483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:43.352946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:43.353379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:43.479597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:43.488370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6afdce35-3195-4db3-927d-fbe6c1f417e4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147924 Sep 11 05:56:43.488933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1599/2975] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:44.062471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:44.063025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:44.069615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.070108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.070551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.071249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.071739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.072241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.081634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:44.082259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:44.088482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.088978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.090048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.090837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.091303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.091736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.155962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.164327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29b4031d-b0c9-4409-94e0-1b75ed5764e8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086430 Sep 11 05:56:44.164905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1600/2976] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:44.204275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.212801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.214812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.216124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b6ce16b-091d-4b74-842d-88415beaac9c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157678 Sep 11 05:56:44.216678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1377/2977] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:44 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:44.217009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:44.217719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:44.223548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.224063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.224502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.225190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.225645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.226071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.302751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:44.303371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:44.309956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.310456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.310887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.311589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.312071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.312555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.361280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.369557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68026b2d-f723-40ca-abdf-3ef0dbe43402 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156365 Sep 11 05:56:44.370129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1601/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:44 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:44.440657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.448836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0272be08-cfc3-4a02-9c79-ebc94fc8d8d1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149949 Sep 11 05:56:44.449404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1378/2979] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:44.512230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:44.512847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:44.518993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.519473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.519934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.520677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:44.521130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:44.521547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:44.647850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:44.656914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98df86d6-da1b-4514-8c9e-0597098017f7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148800 Sep 11 05:56:44.657477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1602/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:44 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:45.188092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:45.188709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:45.195122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.195604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.196058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.196745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.197198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.197617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.241375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:45.241982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:45.248850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.249325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.249759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.250447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.250893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.251321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.264738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.274409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-286744b0-e44e-44d6-b84c-daecf5c5faf3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090199 Sep 11 05:56:45.274984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1379/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:45.382725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.392431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.393501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:45.393876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.394124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:45.395042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ee4e145-07f2-45e4-bf4c-617426735507 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.157523 Sep 11 05:56:45.395659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1603/2982] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:45 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:45.400077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.400637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.401086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.401795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.402255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.402687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.470975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:45.471750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:45.478250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.478741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.479187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.479939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.480528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.480958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.548701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.557577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b22f11cc-c935-43ef-a6c8-27096cc9ab87 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.168109 Sep 11 05:56:45.558874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1380/2983] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:45 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:45.621351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.629797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a42c1ea-342b-442f-9a46-3b19f4923f16 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.162938 Sep 11 05:56:45.630369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1604/2984] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:45.680565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:45.681175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:45.687766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.688279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.688719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.689405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:45.689862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:45.690316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:45.815626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:45.823838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2271f514-f207-4763-b201-358883061b59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147053 Sep 11 05:56:45.824641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1381/2985] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:46.405276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.405895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:46.411757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.412268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.412710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.413399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.413858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.414284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.535102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.535724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:46.541691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.541956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.542724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.543184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.543876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.544364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.544795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.544931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:46.552414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5468ae93-4859-4df7-81b0-b6f808b22d7b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.258629 Sep 11 05:56:46.552987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1605/2986] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:46.587806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.589224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:46.595590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.596108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.596550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.597252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.597709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.598137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.684583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.693523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.694974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.696197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b63829d0-41cf-4d27-9f5e-794818101d5c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 200 len: 1801 microversion: 2.20 time: 0.279769 Sep 11 05:56:46.696968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1382/2987] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:46 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 1801 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:46.702219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.702830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:46.708753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.709242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.709685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.710381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.710845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.711277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.734330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.742564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0103296a-6e67-42ad-b6a0-bf8e58ddf168 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158551 Sep 11 05:56:46.743365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1606/2988] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:46.748462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65805998-93fb-4713-9838-a493e6846ea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '.version_select at 0x7f2c42970a60>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.773676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65805998-93fb-4713-9838-a493e6846ea7 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116270512" status: 204 len: 0 microversion: 2.20 time: 0.029234 Sep 11 05:56:46.774695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1607/2989] 10.222.0.33 () {60 vars in 1262 bytes} [Sun Sep 11 05:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116270512 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 05:56:46.849591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:46.850944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:46.858321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.859213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.859736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.860553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:46.860940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:46.861165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:46.861857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:46.873852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e57e99c6-12a9-4c8a-aaec-dde630db2102 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.175843 Sep 11 05:56:46.876047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1383/2990] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:47.073984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:47.082844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f13c620e-5f77-4237-8481-43a7a3970283 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.239018 Sep 11 05:56:47.083491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1608/2991] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:47.576342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:47.576978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:47.583939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.584464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.584906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.585622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.586078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.586506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.653406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:47.661990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee1a50fa-107b-4ffe-bdc9-5d5fab073cd5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089601 Sep 11 05:56:47.662573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1384/2992] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:47.769590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:47.770525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:47.778149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.778648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.779088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.780035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.780271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.780710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.898436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:47.899043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:47.905503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.905986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.906419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.907104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:47.907615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:47.908058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:47.984968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:47.993734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbd84ddd-7cb2-4cf8-aded-6df3571546fa tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.229913 Sep 11 05:56:47.994402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1609/2993] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:48.050139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:48.060175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf2ab3a8-d11c-497b-a6f1-f62bcb942234 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.165410 Sep 11 05:56:48.061270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1385/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:48.107020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:48.107790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:48.114175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:48.114761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:48.115300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:48.116147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:48.116668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:48.117162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:48.139907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:48.160624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:48.161114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:48.161563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:48.176471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] Creating event network-changed:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:56:48.183493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-47b33ba6-85d3-4bd5-835a-c0986bdd5e71 req-53b72dc3-6f06-436f-9e29-9284135ae1c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047407 Sep 11 05:56:48.184679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1386/2995] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:56:48.304356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:48.316295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8241bedc-cdd4-4958-b282-f84bd3b42a6d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.213452 Sep 11 05:56:48.317770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1610/2996] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:48.363111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d054701e-b532-4702-950f-66ebe5ae6267 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: .version_select at 0x7f2c42925430>, body: {"keypair": {"name": "tempest-keypair-818532553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED/XLQWI3YlYmQDjKyEO0JBt+r6c6AaSHLuhdoo+/x4DTJfbqnsg54Q3SpgMToY31zUzy36BuClhXVfUzj7yAJ6aKyaSavkR8NU6jZPI6tq2lGkilWnuKJ9FE+tkqsKDg=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:48.381631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-d054701e-b532-4702-950f-66ebe5ae6267 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for project 37c662b75f1d46619c3993132d413549. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:56:48.388205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-d054701e-b532-4702-950f-66ebe5ae6267 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for user 0d1dbe40cb994491bafc6ce1f947f4f6 and project 37c662b75f1d46619c3993132d413549. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:56:48.416246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d054701e-b532-4702-950f-66ebe5ae6267 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057156 Sep 11 05:56:48.417280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1387/2997] 10.222.0.33 () {62 vars in 1200 bytes} [Sun Sep 11 05:56:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 05:56:48.686590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:48.687266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:48.694250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:48.694659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:48.695298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:48.696218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:48.696879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:48.697489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:48.804649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:48.818169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6840fe17-5524-45eb-b3fe-9b25716f16e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.133697 Sep 11 05:56:48.818793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1611/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:49.017696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:49.019043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:49.025542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.026037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.027041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.027758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.028436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.029044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.084916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:49.085823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:49.095422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.096368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.097087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.098837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.099569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.100438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.341949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:49.350582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03c2c957-3e33-4b94-b392-8e38d4ed853b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.337523 Sep 11 05:56:49.352467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1388/2999] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:49.394323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:49.403456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3ea61f2-4ea5-4a16-8c13-597654d60116 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.323914 Sep 11 05:56:49.418072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1612/3000] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:49.431247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:49.431949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:49.439481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.442240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.442876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.443778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.444494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.445129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.454955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2851309b-4933-4d3c-950d-e9d28f857dfe", "name": "network-vif-deleted", "tag": "bce749ff-0f59-438d-a26e-7650913736db"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:49.464704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.465460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.466107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.481747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] Creating event network-vif-deleted:bce749ff-0f59-438d-a26e-7650913736db for instance 2851309b-4933-4d3c-950d-e9d28f857dfe on hv-cinder-85692 Sep 11 05:56:49.486969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-951b91eb-8821-433c-8869-20f4c070a137 req-24b34666-e6ee-4917-888a-ad9ed2c47652 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133029 Sep 11 05:56:49.487734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1389/3001] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:56:49.653104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:49.662728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6db8ec21-54d0-4cb7-a1f7-de31d69a5e98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.243305 Sep 11 05:56:49.664094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1613/3002] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:49.842924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:49.843680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:49.849982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.850571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.851079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.851794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:49.852278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:49.852814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:49.857203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:49.916446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:49.925238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9358a75f-6a15-499c-9ea2-be392d72a4ca tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086711 Sep 11 05:56:49.925733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1390/3003] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:50.150154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1448414053", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58a2a799-a636-430c-8f78-e9d1e031567c"}], "security_groups": [{"name": "tempest-securitygroup--1093636589"}], "key_name": "tempest-keypair-818532553", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:50.253804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] validate_networks() for [('58a2a799-a636-430c-8f78-e9d1e031567c', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:56:50.373783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:50.374400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:50.380951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.381446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.381891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.382595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.383055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.383486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.525441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.534593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3b557c4-4480-43a7-9a48-8d89b891fbeb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.164810 Sep 11 05:56:50.535370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1391/3004] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:50 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:50.539626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:50.540256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:50.546450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.546931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.547371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.548081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.548535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.548956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.677099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.686091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6adbf520-d911-4c31-8446-741ef3d9f77e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149929 Sep 11 05:56:50.686768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1392/3005] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:50.689180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:56:50.689642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:56:50.690121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:56:50.690534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:56:50.690950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:56:50.691437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:50.692073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:50.697978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.698487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.698927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.699817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.700601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.701033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.701538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.702156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.702619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.703496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.704176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.704685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.721949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for project 37c662b75f1d46619c3993132d413549. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:56:50.726047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Getting quotas for user 0d1dbe40cb994491bafc6ce1f947f4f6 and project 37c662b75f1d46619c3993132d413549. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:56:50.737956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:56:50.740393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:56:50.791890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7aac7b0b-e520-4d97-9fab-34da58971bf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.643741 Sep 11 05:56:50.791890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1614/3006] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Sep 11 05:56:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 05:56:50.801774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:50.802387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:50.844017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.852157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4fd70c3-98bd-4558-8102-7c6a3f4c615f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.164409 Sep 11 05:56:50.852715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1393/3007] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:50.857309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.865566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.867162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:50.868531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-969a67c8-d190-4e08-9a9e-d81cacf0c904 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1281 microversion: 2.20 time: 0.070616 Sep 11 05:56:50.869350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1615/3008] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:50 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:50.947980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:50.949136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:50.955228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.955719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.956195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:50.956899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:50.957357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:50.957785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.019859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.029588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46388ef0-2781-4de2-bc43-7f5f9cf00b66 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085312 Sep 11 05:56:51.030292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1394/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:51.558731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:51.559350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:51.566813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.567514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.567962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.568692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.569153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.569597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.706867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.709443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:51.710068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:51.716165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7731ca7b-d362-4f8d-8aa9-986cb03d8c58 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.161499 Sep 11 05:56:51.716717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.716880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1616/3010] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:51 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:51.717200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.717642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.718350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.718807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.719390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.850464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.859204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5088a78d-f81f-4129-88cb-d922a0ae6b19 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153657 Sep 11 05:56:51.859770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1395/3011] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:51.875646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:51.876284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:51.882224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.882708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.883143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.883824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.884307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.884731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.892374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:51.892993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:51.898890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.899379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.899886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.900619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:51.901083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:51.902046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:51.962628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.971440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.972928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:51.974044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-312b582f-6ed4-4d72-bfc1-252b4b5872e6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1333 microversion: 2.20 time: 0.085895 Sep 11 05:56:51.974604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1396/3012] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:51 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:52.019352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:52.028208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4e843db-81d3-4d36-80d4-ea8b463d1235 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156333 Sep 11 05:56:52.028807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1617/3013] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:51 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:52.052418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:52.052986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:52.059659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.060215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.060665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.061364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.061823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.062461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.133525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:52.142388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb5741ba-659b-4957-ab5a-eb2de6392271 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.093536 Sep 11 05:56:52.142968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1397/3014] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:52.740617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:52.741393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:52.748667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.749288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.749975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.751047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.751636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.752320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.885142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:52.887837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:52.894748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:52.896096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.896596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.897103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.897844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:52.898482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:52.898911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:52.916017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-340b5450-41e2-4758-9a6e-ed3ed2238f0b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.179179 Sep 11 05:56:52.920100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1618/3015] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:52 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:52.999707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:53.000611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:53.007975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.009141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.009917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.011518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.012264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.012935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.108329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.117027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cd8da36-c233-49b3-a232-ebcb49370bbc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.237983 Sep 11 05:56:53.117732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1398/3016] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:53.123606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:53.124564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:53.131395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.132211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.132856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.133765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.134295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.134790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.150826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.175705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.177174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.178406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2139d05-606c-482b-b663-43dc93387cab tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.183514 Sep 11 05:56:53.179160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1619/3017] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:52 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:53.190649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:53.191748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:53.199412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.200106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.200641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.201475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.202007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.202436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.273792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.283093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4abfc3fc-8dd6-4d07-a399-c883a91a9a8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.102413 Sep 11 05:56:53.283683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1620/3018] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:53.590022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:53.598153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f02a36c3-ae1f-4fc8-bf0e-1ee25834c964 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.479231 Sep 11 05:56:53.599094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1399/3019] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:53.942429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:53.943771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:53.950466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.950983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.951418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.952141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.952633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.953025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:53.975894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:53.988436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:53.989524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:53.990330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.004379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] Creating event network-changed:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 05:56:54.009714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6223e4d7-bfda-463e-a46e-d467717c1205 req-e5be7731-da64-4316-8b6a-c840828ca5a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038374 Sep 11 05:56:54.010787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1400/3020] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:56:54.102993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.111469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25397f5c-4e03-459a-bd9f-35cc79a62027 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.172933 Sep 11 05:56:54.112066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1621/3021] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:54.141959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:54.142917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:54.148991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.149475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.149918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.150615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.151073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.152106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.204519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:54.205136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:54.211076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.211569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.212027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.212731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.213216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.213683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.342947 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.351303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.352904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.354098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f279df57-679e-45ca-b08d-d74387d36abe tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.153590 Sep 11 05:56:54.354851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1622/3022] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:54 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 05:56:54.366427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.368204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:54.369042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:54.372997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:54.377265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.377824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38f8cf89-258b-4480-91a5-1045654ddf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.239948 Sep 11 05:56:54.377985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.378438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.378993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1401/3023] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:54.379219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.379686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.380153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.443691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.452970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d443338-b29b-4ed0-ad33-965dea04f656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.097057 Sep 11 05:56:54.453551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1623/3024] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:54.621958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:54.622584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:54.628424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.628909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.629348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.630040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:54.630496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:54.630924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:54.757090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:54.765477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d082931f-20b6-45bd-bfe7-5ee039a74e0b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148196 Sep 11 05:56:54.766043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1402/3025] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:55.134541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:55.135152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:55.141563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.142295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.142737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.143417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.143874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.144329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.281432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.289779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fc503d8-680b-4449-8498-ed6bc3efd431 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159136 Sep 11 05:56:55.290345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1624/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:55.379740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:55.380383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:55.387409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.387829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.388298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.388993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.389448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.389875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.402944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:55.403560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:55.409584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.410070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.410506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.411201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.411657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.412115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.414667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:55.523387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.532145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.533680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.534804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e500626-c37a-48e8-a546-cc9ec43e6afb tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.158980 Sep 11 05:56:55.535356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1403/3027] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:55 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:55.548155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:55.548155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:55.548155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:55.548787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.548916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.548916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.549136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.549637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.550091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.550521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.555584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd41463f-6646-4f80-ae30-2f094c5193cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157158 Sep 11 05:56:55.556186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1625/3028] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:55.616764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.624893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a106e0f-fa05-4d2f-bc78-4ee5621b0619 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088585 Sep 11 05:56:55.625443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1404/3029] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:55.788727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:55.789259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:55.795502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.795984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.796446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.797133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:55.797582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:55.798003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:55.930063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:55.939048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc497bcb-3e1d-4ca6-8d15-b59c0462dde1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154273 Sep 11 05:56:55.939584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1626/3030] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:56.314028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:56.314646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:56.320699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.321182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.321630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.322319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.322778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.323843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.455434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.463740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12a643dd-3500-4ef5-aa48-fddfb8582b54 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153655 Sep 11 05:56:56.464350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1405/3031] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:56.561619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:56.562262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:56.568642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.569128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.569566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.570255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.570709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.571134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.579203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:56.579807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:56.585650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.586128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.586566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.587251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.587707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.588154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.703176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.711203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.712686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.713999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67db7dd2-e930-4c3b-9a74-ffe7c350956f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.156766 Sep 11 05:56:56.714873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1627/3032] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:56 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:56.717773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.719289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:56.719905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:56.725683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.726157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6092e2a0-2ac7-403f-81f6-bdd1875c0da5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150762 Sep 11 05:56:56.726302 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.726590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.727279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.727738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.728195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.737905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1406/3033] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:56.791105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:56.800562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8dec17e-c7f1-4f6e-9c76-ce201a702cde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084649 Sep 11 05:56:56.801340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1628/3034] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:56.962373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:56.962982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:56.969560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.970043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.970479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.971177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:56.971633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:56.972104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:56.988026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:57.186172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.194754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3fcfad32-2f6d-4140-930b-ec1151b12672 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.236244 Sep 11 05:56:57.195522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1407/3035] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:57.486592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:57.487202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:57.493175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.493683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.494117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.494798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.496813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.497244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.627574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.635803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9080f461-08c3-4f37-81c4-a5a2435ead53 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153014 Sep 11 05:56:57.636739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1629/3036] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:57 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:57.738896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:57.739530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:57.747090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.747578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.750220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.750220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.750220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.750220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.750679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:57.751335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:57.757438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.758003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.758516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.759273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.759808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.760340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.883266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.893272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.894680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.895822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c6ad2f8-e8e9-481b-b73b-f21fde955c54 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.161006 Sep 11 05:56:57.897407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1408/3037] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:57 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:57.898994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.903097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:57.903838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:57.910261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.910885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.911834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.912300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:57.912863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:57.913392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:57.913594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1584cf8-b898-4eae-b490-757a702c9a1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.167143 Sep 11 05:56:57.914439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1630/3038] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:57.980538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:57.988743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-90206b9d-3be2-46f1-82b4-b7cecdc293cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089837 Sep 11 05:56:57.989306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1409/3039] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:58.219281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:58.219817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:58.225797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.226273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.226705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.227382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.227830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.228279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.357828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:58.365854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ccb2ea5-10e8-49c0-9b4f-56d65050d773 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150607 Sep 11 05:56:58.366414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1631/3040] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:58 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:58.659084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:58.659698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:58.661607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:56:58.667039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.667522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.667982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.668690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.669145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.669567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.798255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:58.806550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e852372a-d87a-4ba5-8525-8f6c195bd25d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151321 Sep 11 05:56:58.807120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1410/3041] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:58 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:58.921282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:58.921858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:58.928674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.929160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.929590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.930279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.930721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.931148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.937624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:58.938235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:58.943966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.944481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.944918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:58.945606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:58.946070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:58.946481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.063008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.071110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.072649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.074069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89ad04fe-d88f-4cc0-bb7e-83fa89906171 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.157519 Sep 11 05:56:59.074622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1632/3042] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:56:58 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:56:59.078163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.078996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:59.079595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:59.085390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.085877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.086313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.087003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.087322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3e06f1a-9840-469d-8c2b-033501a4bedf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154576 Sep 11 05:56:59.087460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.092239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.092407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1411/3043] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:56:59.149170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.159256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-829ca463-6305-46c2-aac5-44c98c25867a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083497 Sep 11 05:56:59.160074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1633/3044] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:59.375237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "name": "network-vif-plugged", "status": "completed", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:56:59.386394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.386886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.387317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.392346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:59.392971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:59.398959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.399142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] Creating event network-vif-plugged:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 05:56:59.399454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.399898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.400623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.401085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.402120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.404963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6fc3dca2-c98d-4016-9882-0b8da9908d0a req-83868f9a-2c7a-447e-b699-e70f1ddf58f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091046 Sep 11 05:56:59.405733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1412/3045] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:56:59.543347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.552071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca1f4b6b-b485-4d89-9671-ac476b3f9922 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.163848 Sep 11 05:56:59.552647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1634/3046] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:56:59.831348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:56:59.832075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:56:59.838156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.838649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.839092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.839795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:56:59.840288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:56:59.840720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:56:59.968914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:56:59.977132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-89818e25-c803-4dbf-9494-b52b6c953ffb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150537 Sep 11 05:56:59.977699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1413/3047] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:56:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:00.099051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:00.099653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:00.106134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.106623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.107168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.107865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.108343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.108770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.110379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:00.110997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:00.117056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.117542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.117988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.118715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.119175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.119607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.240017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.248850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.250298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.251416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d47f6fbd-5c99-486f-bf9f-426b015128b0 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1407 microversion: 2.20 time: 0.156359 Sep 11 05:57:00.251984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1635/3048] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:57:00 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:57:00.254034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.256402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:00.257013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:00.263313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7809a7f-c685-49f9-ac45-4018177ec8b1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156695 Sep 11 05:57:00.263629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.263898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1414/3049] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:00.264531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.264970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.265938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.266401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.266832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.327199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.335420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19987956-3c8e-4dd2-8883-21d7fcd0f239 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082464 Sep 11 05:57:00.335965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1636/3050] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:00.576873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:00.577508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:00.583297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.583768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.584242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.584923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:00.585370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:00.585789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:00.712096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:00.720413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb46146c-e294-4316-85ad-d2e7adbd4633 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147422 Sep 11 05:57:00.720980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1415/3051] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:01.000578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.001200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.003086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:01.003840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=8 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:01.009381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.009870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.010309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.011014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.011468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.011898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.141981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.150412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77417620-4134-44dc-aae3-abb58f56116d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153685 Sep 11 05:57:01.150968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1637/3052] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:01.277215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.278421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.284926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.285412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.285852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.286549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.286694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.287006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.287198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.287434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.293176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.293668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.294303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.295014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.295478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.295912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.417820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.425910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.426089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.427501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.428708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3642b77f-4090-440e-b0b0-3429f0488a46 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1598 microversion: 2.20 time: 0.155400 Sep 11 05:57:01.429285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1416/3053] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 05:57:01 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 05:57:01.433677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.434330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.435039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5166d431-eab4-4696-8177-7801e2d3b08e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152219 Sep 11 05:57:01.435776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1638/3054] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:01.440663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.441155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.441596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.442504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.442969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.443399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.453949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.454528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.460714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.461228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.461665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.462409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.462860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.463283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.509095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.518261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61a6729d-8727-47fd-a9b8-d6b59384a202 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088021 Sep 11 05:57:01.519041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1417/3055] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:01.542221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-077bd1e7-e990-48f8-8dc4-358fd79cac2f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092983 Sep 11 05:57:01.542826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1639/3056] 10.222.0.33 () {60 vars in 1316 bytes} [Sun Sep 11 05:57:01 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:57:01.744364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:01.745004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:01.751858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.752392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.752838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.753890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:01.754353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:01.754789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:01.903648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:01.912084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d83eac0e-c149-48af-91ae-c7e104785bd6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.171760 Sep 11 05:57:01.912859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1418/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:01 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:02.175610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:02.176333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:02.182706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.183351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.183799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.185563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.186215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.186830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.458851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:02.459471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:02.466438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.466928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.467370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.468117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.468578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.469005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.525076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:02.534540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4e97e5a-7f2b-4ede-a8a4-d7eaabf5d80d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.363535 Sep 11 05:57:02.541763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1640/3058] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:02.541763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:02.542206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:02.549254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.549973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.550601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.551313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.551777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.552238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.609382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:02.617586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00d07604-40b8-4b78-bd8f-29e989e951db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.162659 Sep 11 05:57:02.618166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1419/3059] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:02.653380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:02.661953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79aa40d1-0404-48b6-821a-6177841901f5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.123935 Sep 11 05:57:02.662655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1641/3060] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:02.863357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:57:02.872782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.873262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.873692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.884356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] Creating event network-changed:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 05:57:02.890198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-8e2d826f-e267-4dd1-9539-c079abaff030 req-14d59001-c81d-4b08-a5a1-22540932decf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030428 Sep 11 05:57:02.890787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1420/3061] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:57:02.935311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:02.936382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:02.942750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.943242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.943685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.944420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:02.944909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:02.945301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:02.951030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:03.086916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:03.098289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e6fd909-4a98-4bcd-8513-00f56b5a0c46 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.166766 Sep 11 05:57:03.098879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1642/3062] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:03.561389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:03.562134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:03.568465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.568947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.569383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.570076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.570529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.570953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.642545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:03.643084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:03.649359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.649845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.650278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.650976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.651426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.651849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.710244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:03.718969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-362594ce-9394-4def-8867-a4de7c1898f7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162344 Sep 11 05:57:03.719713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1421/3063] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:03 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:03.724781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:03.725554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:03.732337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.732837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.733265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.733991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:03.734447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:03.734869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:03.796822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:03.810352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c20c358-e69d-421f-a5b6-e2cce92121d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.172117 Sep 11 05:57:03.811153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1643/3064] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:03.816580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:03.821517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3b3f2ea-9eab-4677-80be-f63aa82b1b71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.100416 Sep 11 05:57:03.822073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1422/3065] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:04.122286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:04.122904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:04.128981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.129470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.129940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.130638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.131101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.131532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.259832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:04.269137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9aea304e-df14-48f8-8a18-4d76528227f6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151508 Sep 11 05:57:04.269703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1644/3066] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:04.742707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:04.743351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:04.750077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.750559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.750996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.751685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.752171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.752590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.835005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:04.835624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:04.843022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.843517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.843957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.844686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.845143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.845734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.881435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:04.889819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ebef120-84ff-4899-820a-a6fbbeb1a49b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150919 Sep 11 05:57:04.890408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1423/3067] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:04 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:04.895120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:04.895725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:04.901488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.901984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.902425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.903656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:04.904231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:04.904668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:04.965692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:04.973780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a1dfbcf-2152-49f9-9af6-cc65fe5444bd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082410 Sep 11 05:57:04.974346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1424/3068] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:04.980169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:04.988892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf04939d-97a8-4f5a-ac00-a95cd5617063 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157771 Sep 11 05:57:04.989457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1645/3069] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:05.292697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:05.293351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:05.299322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:05.299805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:05.300274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:05.300968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:05.301427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:05.301856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:05.316861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:05.435451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:05.443734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b12167c9-d649-4ae1-8909-a2f5dcb47f93 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154868 Sep 11 05:57:05.444332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1425/3070] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:05.912849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:05.913601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:05.920784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:05.921497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:05.921923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:05.922621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:05.923076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:05.923571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:05.998393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:05.999008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:06.009310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.009810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.010251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.011649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.012072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.012509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.060631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:06.068766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c41987db-30a0-4e7e-816d-73090f86fae7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159771 Sep 11 05:57:06.069522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1646/3071] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:06.074063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:06.074674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:06.080975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:06.083197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.084040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.084695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.085614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.086077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.086507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.090200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6944658c-b7c8-4c92-a229-01142bc08054 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.097234 Sep 11 05:57:06.090773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1426/3072] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:06.222544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:06.230609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57481f87-80ca-40e2-96a5-147aa7265d58 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.160068 Sep 11 05:57:06.231169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1647/3073] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:06.467017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:06.467622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:06.473713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.474201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.474636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.475318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:06.475766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:06.476228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:06.602225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:06.610366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9db7f0ee-3b58-40e2-9e2e-539f66305755 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147622 Sep 11 05:57:06.610934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1427/3074] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:07.093728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:07.094348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:07.100781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.101265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.101703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.102391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.102850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.103279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.114712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:07.115321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:07.121827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.122320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.122766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.123435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.123885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.124335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.188532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:07.196856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8988f78b-9c21-4b99-888c-b833da7b43fc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085928 Sep 11 05:57:07.197706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1428/3075] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:07.235593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:07.243735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-577eecd6-b801-4512-b2d3-6b969a8a5ac0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154597 Sep 11 05:57:07.244327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1648/3076] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:07 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:07.253366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:07.253978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:07.259770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.260281 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.260717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.261397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.261843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.262263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.396812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:07.405161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-edcdb910-6d37-4897-9eb2-a6979b25c272 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.155560 Sep 11 05:57:07.405731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1429/3077] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:07.632697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:07.633349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:07.639699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.640223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.640660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.641346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:07.641798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:07.642485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:07.771142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:07.780297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32f22ee6-7bf9-45fa-a376-3c88a881bc1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151459 Sep 11 05:57:07.780857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1649/3078] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:08.220429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:08.221038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:08.227348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.227826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.228289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.228968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.229422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.229840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.267348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:08.268114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:08.274316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.274800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.275234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.275926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.276417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.276841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.290821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:08.299317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b6cbaf3-97e2-46e7-b904-4aac7b62a215 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083536 Sep 11 05:57:08.299889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1430/3079] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:08.410401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:08.418432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c350e0d8-42be-4112-84f7-8a488dde9e48 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155698 Sep 11 05:57:08.418990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1650/3080] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:08.427972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:08.428632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:08.434532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.435621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.436081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.436774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.437226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.437652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.565223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:08.573360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9475c48-2acb-4d06-aa41-65cd0fd9857a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149265 Sep 11 05:57:08.573926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1431/3081] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:08.804686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:08.805306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:08.811559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.812083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.812531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.813227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:08.813686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:08.814116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:08.942734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:08.951485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4d1b2dc-6167-4a26-97d8-c504b06f1a59 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150753 Sep 11 05:57:08.952069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1651/3082] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:09.322120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:09.322732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:09.330166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.330683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.331125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.331820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.332308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.332740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.395133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:09.403369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb7d09c3-5723-464f-bc00-c2ea054a62c8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085271 Sep 11 05:57:09.404303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1432/3083] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:09.441960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:09.442655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:09.449100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.449590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.450031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.451420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.451958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.452429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.582646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:09.590736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-849b1240-628a-4b02-975b-3a1d746eccfd tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152682 Sep 11 05:57:09.591554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1652/3084] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:09.596611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:09.597261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:09.603115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.603602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.604069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.604766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.605227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.605656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.733010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:09.741087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6bf8981-37d7-4e62-ae2f-599e1d7c00db tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148458 Sep 11 05:57:09.741650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1433/3085] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:09.974895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:09.975516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:09.981467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.982727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.983164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:09.983860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:09.984352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:09.984782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.110407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:10.118613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab86198e-57f9-472b-b994-d8bd1b29bf19 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147642 Sep 11 05:57:10.119183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1653/3086] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:10.426599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:10.427303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:10.433979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.434478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.434970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.435755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.436324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.436770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.500958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:10.509112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a2390eb-0fdf-4762-bebd-5c2451c5f040 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086692 Sep 11 05:57:10.509674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1434/3087] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:10.613470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:10.614137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:10.620632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.621123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.621568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.622781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.623417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.623854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.754833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:10.763852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f9aa25b-6f58-4928-bb12-f5017fed6f9f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153670 Sep 11 05:57:10.764441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1654/3088] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:10.764948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:10.765562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:10.771863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.772369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.772804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.773491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:10.773941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:10.774366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:10.899990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:10.908179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-553e7dc5-3628-4360-bca9-f1c2993d62f2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148046 Sep 11 05:57:10.908757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1435/3089] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:11.143318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:11.143935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:11.149993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.150475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.150909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.151603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.152085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.152537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.278645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:11.287043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a013f64-e0fb-4ffe-8cd0-048935a27007 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147892 Sep 11 05:57:11.287604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1655/3090] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:11.533600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:11.534178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:11.540587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.541075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.541519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.542212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.542669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.543096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.604594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:11.613340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e1b6877-c502-4b7c-8013-de328622b9c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083883 Sep 11 05:57:11.613908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1436/3091] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:11.787174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:11.787857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:11.795306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.795791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.796250 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.796942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.797393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.797816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.925530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:11.930692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:11.931432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:11.933938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d73ed2e-627f-448c-b3b2-31c58d6202b1 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150800 Sep 11 05:57:11.934522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1656/3092] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:11 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:11.938379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.938872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.939317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:11.940044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:11.940508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:11.941138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.072133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:12.080732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3beb8c1-ea25-4ad8-bb6c-550df5159e4e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153899 Sep 11 05:57:12.081307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1437/3093] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:12.310912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:12.311516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:12.317428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.317908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.318337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.319016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.319514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.319882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.451371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:12.459382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-351a4eac-36ee-45d2-a7de-e7484ee26d7b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152651 Sep 11 05:57:12.459938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1657/3094] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:12.636300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:12.636922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:12.644529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.645020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.645467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.646166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.646630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.647062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.711066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:12.719918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9d1945bb-0077-445c-988a-425f3a0569b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087620 Sep 11 05:57:12.720518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1438/3095] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:12.957976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:12.958529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:12.965031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.965518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.965982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:12.966713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:12.967195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:12.967632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.095569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:13.097743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:13.104809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:13.104995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be536de5-4ce5-481b-a041-e563de275e40 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150893 Sep 11 05:57:13.105413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1658/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:13.105542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:13.111911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.112429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.112860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.113543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.113995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.114411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.241439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:13.250310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5191706-bcf2-47de-8223-713f77024891 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149394 Sep 11 05:57:13.250878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1439/3097] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:13 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:13.483772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:13.484315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:13.490399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.490883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.491321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.492031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.492485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.492914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.622922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:13.631104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98c62101-9975-4fe6-953f-5133f8c2532a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151456 Sep 11 05:57:13.631664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1659/3098] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:13.742677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:13.743311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:13.751208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.751695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.752168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.752862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:13.753314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:13.753740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:13.819078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:13.828311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53161215-ba1b-49e1-93b2-162da4e8e9bf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089536 Sep 11 05:57:13.828880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1440/3099] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:14.132473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:14.133093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:14.142938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.143419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.143854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.144574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.145033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.145556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.273346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:14.273963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:14.274792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:14.280075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.280568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.281011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.281718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.282206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.282638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.283482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8fde1b5-5971-4678-8872-60c502935928 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159166 Sep 11 05:57:14.284065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1660/3100] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:14.408480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:14.416652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ea446cb-53ed-4e0d-b028-d2b0b071cb0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147188 Sep 11 05:57:14.417221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1441/3101] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:14.656398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:14.657041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:14.662931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.663411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.663846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.664575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.665031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.665454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.792857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:14.802041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db863bc6-3e90-4854-b5d8-42f19b4d3d12 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150439 Sep 11 05:57:14.802619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1661/3102] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:14.850840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:14.851455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:14.858496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.858978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.859416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.860142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:14.860600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:14.861026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:14.863517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:14.923836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:14.932063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73b0f2b6-1350-4d27-a56e-573b6965825e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085018 Sep 11 05:57:14.932623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1442/3103] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:15.306707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:15.307320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:15.314078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.314558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.314988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.315668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.316145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.316570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.442718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:15.443367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:15.449340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.449829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.450847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.451640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.451775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:15.452125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.452561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.460140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c546f90a-c2c1-4e38-ae84-499318df6219 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157264 Sep 11 05:57:15.460710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1662/3104] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:15.584172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:15.593064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ceadec7-ce38-4c84-a334-fe84835b052a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154308 Sep 11 05:57:15.593926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1443/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:15.826390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:15.827006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:15.832968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.833449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.833881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.834568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.835023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.835450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.955982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:15.956616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:15.961260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:15.963273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.963629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.964111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.964820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:15.965277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:15.966239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:15.970358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ee8bb9d-bee5-4ca6-8d57-98fc66953b98 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147973 Sep 11 05:57:15.970924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1663/3106] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:16.027106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:16.035663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-06570e6b-a07b-43d7-aa91-72f3b87155b8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083700 Sep 11 05:57:16.036260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1444/3107] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:16.484950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:16.485591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:16.491928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:16.492441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:16.492874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:16.493559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:16.494006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:16.494426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:16.616480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:16.617229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:16.623756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:16.624399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:16.624838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:16.625547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:16.626093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:16.626521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:16.629176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:16.637342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5addcb04-7211-4042-8686-8af13aeb3ba6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156675 Sep 11 05:57:16.638698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1664/3108] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:16.761463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:16.771655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb014609-e020-4f98-aff5-03ec2c9395df tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.159049 Sep 11 05:57:16.772253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1445/3109] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:16.996838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:16.998419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:17.004716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.005205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.005644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.006373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.006837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.007932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.061721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:17.062640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:17.071775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.072293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.072737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.073440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.073894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.074320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.152881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:17.161255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:17.161587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a478f7d-676f-4d73-b72b-40ae6dd7f0e7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.105844 Sep 11 05:57:17.162468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1446/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:17.170360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-feabd6a6-a738-49d1-b22d-fcda0abd9a20 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.180154 Sep 11 05:57:17.170938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1665/3111] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:17.662573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:17.663185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:17.669696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.670186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.670624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.671313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.671766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.672229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.800354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:17.800968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:17.805730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:17.808108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.808600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.809041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.809950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:17.810418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:17.810848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:17.814375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6652f4ed-5f6c-45f3-8ae7-1e66195626b7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155801 Sep 11 05:57:17.814957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1447/3112] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:17 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:17.942115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:17.951238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a44fdfb6-0cec-4d77-95cc-fbc80aa14320 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154877 Sep 11 05:57:17.951810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1666/3113] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:18.193169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:18.193825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:18.194164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:18.194805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:18.202238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.202478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.202723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.202840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.203163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.203297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.203893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.204047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.204377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.204496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.204802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.204922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.266867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:18.275163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee80474d-b49b-4f56-9879-3ed4c49ca52d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086801 Sep 11 05:57:18.275725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1448/3114] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:18.333466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:18.341650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33b61786-0493-47c1-8689-8a2d1bf8b159 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151329 Sep 11 05:57:18.342206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1667/3115] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:18.837404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:18.838025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:18.844591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.845081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.845540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.846225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.846683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.847113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.974699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:18.975592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:18.977827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:18.982406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.982898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.983340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.984072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:18.984540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:18.984964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:18.986248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ef94021-c466-4a37-ada4-a9d7bb2ee96e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152674 Sep 11 05:57:18.986818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1449/3116] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:19.112330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:19.120477 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a51ec85c-979b-4719-9d4a-d18b885f3c2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149628 Sep 11 05:57:19.121044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1668/3117] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:19.298557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:19.299171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:19.305609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:19.306093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:19.306535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:19.307249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:19.307706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:19.308165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:19.365367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:19.365983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:19.370559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:19.372592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:19.373127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:19.373581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:19.374282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:19.374742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:19.375172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:19.379631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-175f579b-e8da-4b0c-9771-df60c5c8bfc7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085446 Sep 11 05:57:19.380224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1450/3118] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:19.503919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:19.512226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff19dad8-c0df-48d5-b5d4-5c41eecb8286 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150685 Sep 11 05:57:19.512888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1669/3119] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:20.009139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:20.009752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:20.016381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.016866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.017570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.018263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.018720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.019146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.144528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:20.144968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:20.145589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:20.151876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.152394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.152833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.152968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1656c076-f5ab-4738-b1ec-bba937276463 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147612 Sep 11 05:57:20.154101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1451/3120] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:20.154671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.155230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.155667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.282141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:20.290294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5900b0e7-4120-44bf-9cdf-44f17b28850f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149427 Sep 11 05:57:20.290861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1670/3121] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:20 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:20.401982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:20.402600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:20.409697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.410184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.410649 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.411337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.411795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.412254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.477266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:20.486544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-42637b11-361b-4421-ad9f-4532deaf4d6b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088403 Sep 11 05:57:20.487192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1452/3122] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:20.535481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:20.536120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:20.541991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.542475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.542914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.543636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:20.544262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:20.544711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:20.674397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:20.682480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e179949b-5bdb-46d9-a146-e94525a923a6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150931 Sep 11 05:57:20.683058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1671/3123] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:21.176496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:21.177115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:21.183059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.183550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.184009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.184748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.185208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.185642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.314638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:21.315260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:21.322194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.322678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.323115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.323818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.324304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.324731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.468665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:21.477279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfe6ce06-ffb5-437a-807c-f46523f6dc59 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.166676 Sep 11 05:57:21.477859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1672/3124] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:21.509533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:21.510147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:21.515617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:21.517828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.518315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.518763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.519437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.519887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.520335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.543007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:21.551315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6ad2248-a241-40f0-aad8-989bc8586796 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.378708 Sep 11 05:57:21.551895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1453/3125] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:21.583294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:21.592093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c74520ff-761e-49de-b065-934cf250bd59 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086382 Sep 11 05:57:21.592657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1673/3126] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:21.706641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:21.707257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:21.709158 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:21.714312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.714795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.715236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.716638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:21.717158 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:21.717592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:21.845349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:21.853498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-533bc04a-62d6-4272-a65f-f7454bda1ea4 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150750 Sep 11 05:57:21.854067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1454/3127] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:22.501119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:22.501660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:22.508117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.508604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.509043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.509728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.510182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.510606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.574902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:22.575671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:22.582062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.582549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.582983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.583690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.584176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.584612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.642882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:22.651297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5f8c741-68ef-4f53-9a44-e3f43fd5aec2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154782 Sep 11 05:57:22.651873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1674/3128] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:22.656946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:22.657549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:22.663364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.663955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.664489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.665275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.665832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.666345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.681838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:22.721988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:22.729071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:22.730166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-232bb03d-1d28-4c2c-90e8-38d6570b9d5c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.159252 Sep 11 05:57:22.730746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1455/3129] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:22 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:22.738138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b22c4bf-e55e-40c3-aab8-b0e27887fe56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085268 Sep 11 05:57:22.738884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1675/3130] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:22.877070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:22.877687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:22.883567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.884081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.884522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:22.885213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:22.885671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:22.886098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.012052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:23.021143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf487c8e-fa09-4a5f-8df8-eb6d9f2ebe28 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147932 Sep 11 05:57:23.021706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1456/3131] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:23.675221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:23.675834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:23.682310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.682790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.683226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.683904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.684438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.685039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.754820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:23.755424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:23.762186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.762960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.763414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.767462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.767960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.768449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.815576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:23.823731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9a9aa37-b2a0-4fbe-b4dc-d2ab61cfadc9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152340 Sep 11 05:57:23.824329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1676/3132] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:23.832970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:23.833587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:23.839378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.839866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.841276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.841653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:23.842065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:23.842496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:23.904428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:23.906916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:23.912843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fde6c4ad-87fc-476a-aabd-4d26d89c4234 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.161913 Sep 11 05:57:23.913425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1457/3133] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:23.915315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d9857e7-dcdd-4b86-985b-fa3051f49570 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090018 Sep 11 05:57:23.915929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1677/3134] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:24.046004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:24.046528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:24.052402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.052866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.053301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.053982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.054434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.054859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.179951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:24.182103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:24.189644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f91fe60e-1e10-45f7-8013-c7c525d8fd91 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148077 Sep 11 05:57:24.190223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1458/3135] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:24 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:24.849295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:24.849912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:24.856455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.856930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.857367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.858055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.858510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.858935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.937763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:24.938340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:24.944830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.945315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.945749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.946436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:24.946887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:24.947306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:24.987928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:24.996483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-466d77bd-8884-4bdb-a3fd-4e6cffc206f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151012 Sep 11 05:57:24.997833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1678/3136] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:25.002289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:25.002915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:25.008657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:25.009156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:25.009600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:25.010299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:25.010762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:25.011194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:25.076341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:25.082767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:25.084826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1e23919-2fb2-4121-b45e-2f3bf2543298 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086006 Sep 11 05:57:25.085403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1679/3137] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:25.091181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1098c1d8-17d8-4ee5-8524-f2ed1ff181e0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158367 Sep 11 05:57:25.091876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1459/3138] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:24 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:25.211942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:25.212574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:25.218423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:25.218905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:25.219347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:25.220051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:25.220510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:25.220940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:25.349644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:25.358819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6be7120-a3b5-40bc-b980-80df560e6d2e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150717 Sep 11 05:57:25.359393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1680/3139] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:26.020360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:26.021038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:26.027338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.027820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.028857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.029553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.030007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.030433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.107842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:26.108535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:26.115107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.115594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.116063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.116760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.117243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.117672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.161721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:26.170606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7df23ce-b23c-481d-bb25-6744dcbecf87 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154364 Sep 11 05:57:26.171180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1460/3140] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:26.175920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:26.176560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:26.182427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.182913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.183349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.184066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.184715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.185142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.187959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:26.196140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4539b654-ac5a-4158-82ec-175111169b4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.092460 Sep 11 05:57:26.196711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1681/3141] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:26.312702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:26.320774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48a06c60-b598-4ab6-b0c6-3605761cc33a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148645 Sep 11 05:57:26.321339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1461/3142] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:26.382646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:26.383187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:26.390200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.390681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.391115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.391797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:26.392525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:26.392949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:26.519430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:26.527602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3779fd2b-f42e-442f-9a13-9768dcd498ee tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148798 Sep 11 05:57:26.528295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1682/3143] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:27.194029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:27.194624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:27.201619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.202088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.202519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.203202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.203652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.204101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.219487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:27.220151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:27.226518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.227009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.227446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.228173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.228633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.229060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.295008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:27.303130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7934410-c56e-42ba-a526-1b6eb17c6669 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087502 Sep 11 05:57:27.303702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1683/3144] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:27.339547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:27.344626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:27.345246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:27.348399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-62c6f529-4d21-4fb0-a8d2-35eaa8713cd1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158190 Sep 11 05:57:27.348964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1462/3145] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:27 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:27.351276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.352160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.352609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.353315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.353780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.354209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.482147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:27.490259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98408432-fb29-477d-a812-712638fb83ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150082 Sep 11 05:57:27.490824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1684/3146] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:27.550828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:27.551435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:27.557358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.557838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.558278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.558972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:27.559578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:27.560070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:27.686034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:27.694184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f2920e0b-e88c-4820-8851-deec07353800 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147192 Sep 11 05:57:27.694801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1463/3147] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:28.326579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:28.327187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:28.333702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.334188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.334629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.335320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.335776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.336241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.372985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:28.373600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:28.380042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.380530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.380965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.381659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.382113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.382534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.398438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:28.407065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4efb01da-1636-4fd8-9d8a-d1d507986c30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084516 Sep 11 05:57:28.407647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1685/3148] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:28.513881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:28.514479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:28.514630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:28.520744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.521229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.521667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.522394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.522846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e85bb2ff-14a0-4d8d-8acd-4d366e73abd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154541 Sep 11 05:57:28.522981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.523278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.523702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1464/3149] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:28.655726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:28.663875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52a812fc-4b62-4b63-b309-c285db050ce8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154456 Sep 11 05:57:28.664466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1686/3150] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:28.717149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:28.717758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:28.723545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.724052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.724491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.725172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:28.725620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:28.726044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:28.853943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:28.862428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a7cc674-f41c-4d8b-af9d-a81d62d254b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149150 Sep 11 05:57:28.862987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1465/3151] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:29.430671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:29.431321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:29.437557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.438032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.438462 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.439145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.439635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.440100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.501343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:29.509419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d565d215-e5a0-4886-a877-cd7b0df44865 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082622 Sep 11 05:57:29.509975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1687/3152] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:29.547293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:29.547907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:29.554452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.554939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.555379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.556113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.556576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.557009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.683851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:29.687229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:29.687846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:29.692661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be1e5c1a-bba4-4730-a5eb-4f3db3fd92f7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149933 Sep 11 05:57:29.693229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1466/3153] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:29.694213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.694692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.695130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.695830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.696312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.696741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.825445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:29.833519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2be8174f-66bf-4442-83e3-ea4640a0b4ec tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150888 Sep 11 05:57:29.834109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1688/3154] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:29 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:29.885949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:29.886555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:29.892952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.893428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.893883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:29.894562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:29.895037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:29.895456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.025221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:30.033548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63ff056c-a6a5-4d4d-a97d-a6277aac6747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151428 Sep 11 05:57:30.034103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1467/3155] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:30.532855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:30.533475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:30.539347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.539826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.540287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.540969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.541419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.541843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.606573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:30.614975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02c42915-2c13-4fb0-9b13-7e78cb3ed989 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086019 Sep 11 05:57:30.615536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1689/3156] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:30.716454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:30.717006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:30.722907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.723386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.723823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.724535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.724991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.725416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.852633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:30.855705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:30.857181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:30.861729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bdc0fc8-1ac3-4351-b74d-07f9b9231492 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149145 Sep 11 05:57:30.862433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1468/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:30.863606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.864120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.864556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.865254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:30.865706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:30.866125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:30.993445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:31.001802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35ad8dc3-643c-4b85-8775-e416c2af62c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149903 Sep 11 05:57:31.002369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1690/3158] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:30 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:31.057256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:31.057900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:31.064360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.064872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.065311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:31.066002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.066458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.066888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:31.195906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:31.204867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68896bc0-c6e7-4252-9fc3-cb91884699a2 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151502 Sep 11 05:57:31.205427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1469/3159] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:31.638263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:31.638866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:31.645239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.645720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.646151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:31.646834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.647289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.647713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:31.708810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:31.717666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eed1f44f-0ffd-47e9-b7e9-7866c4de8baa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083519 Sep 11 05:57:31.718220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1691/3160] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:31.885211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:31.885816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:31.891866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.892586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.893019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:31.893702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:31.894156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:31.894582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.024284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:32.024785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:32.024934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:32.031982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.032519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.032962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.033670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.034133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.034274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4cc090d-613b-4b48-bf35-62d7fad35ec6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153009 Sep 11 05:57:32.034563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.034819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1470/3161] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:32.038660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:32.166795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:32.175291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cc8a539-2064-4631-b273-ef05bbe2c271 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154901 Sep 11 05:57:32.175854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1692/3162] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:32.228672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:32.229283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:32.235627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.236143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.236583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.237271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.237724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.238151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.369307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:32.378072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b41ddf0-1771-4fcd-b37d-8ed490179673 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153269 Sep 11 05:57:32.378640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1471/3163] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:32.741209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:32.741818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:32.747978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.748496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.748938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.749629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:32.750090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:32.750518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:32.812720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:32.820963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6413892-fb3b-4e14-bcc4-5dfc2ba968df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083598 Sep 11 05:57:32.821523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1693/3164] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:33.057771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:33.058331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:33.064419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.064903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.065342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.066032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.066484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.066909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.194772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:33.198194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:33.198813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:33.203887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e29dd6b1-da82-4f0a-9af4-bb38558d5504 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150060 Sep 11 05:57:33.204490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1472/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:33.205900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.206469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.206900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.207595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.208077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.208507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.337964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:33.346171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dd5fae3-dc6a-44bd-99c8-3a1583fb3d4e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151808 Sep 11 05:57:33.346737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1694/3166] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:33.401569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:33.402188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:33.409584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.410073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.410512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.411207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.411663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.412118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.538445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:33.546546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5450da1-4be7-47fa-8257-3db34e2cb9cf tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148930 Sep 11 05:57:33.547114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1473/3167] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:33.845206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:33.845831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:33.851752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.852265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.852699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.853378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:33.853828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:33.854245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:33.919125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:33.927395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bded741d-13b2-4373-bc30-479115b7159d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087010 Sep 11 05:57:33.927957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1695/3168] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:34.228048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:34.228672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:34.235245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.235726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.236206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.236904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.237356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.237779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.368276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:34.373934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:34.374558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:34.377732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a11f542-24e1-4f42-b053-e82e4d510459 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153556 Sep 11 05:57:34.378309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1474/3169] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:34 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:34.381062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.381619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.382125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.382828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.383279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.383704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.511657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:34.520616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8543124f-2780-4f62-99d4-8bcbd750f0eb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154629 Sep 11 05:57:34.521175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1696/3170] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:34.570601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:34.571212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:34.578321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.578788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.579252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.579940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.580421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.580846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.596140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:34.708445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:34.717399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ad6f456-035f-4556-b4be-a04039626bb6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150676 Sep 11 05:57:34.717973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1475/3171] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:34.951274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:34.952057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:34.958070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.958570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.959012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:34.959708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:34.960200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:34.960630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.021627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:35.030368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92a226d4-febd-4046-a088-c678017c3b24 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083602 Sep 11 05:57:35.030929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1697/3172] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:35.405935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:35.406549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:35.412560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.413045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.413488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.414174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.414630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.415057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.544779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:35.545398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:35.546876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:35.551936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.552475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.552915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.553612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.554072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.554504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.555013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56e57702-c15e-4a31-b2df-e686adbb73cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153614 Sep 11 05:57:35.555575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1476/3173] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:35.688333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:35.696509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1559cc0-734c-4a68-8a1b-c554677f3489 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156569 Sep 11 05:57:35.697081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1698/3174] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:35.740612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:35.741224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:35.747921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.748371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.748814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.749498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:35.749950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:35.750371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:35.877611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:35.885796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29abf0cd-8c51-44f5-b381-06c25589a3cb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148955 Sep 11 05:57:35.886340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1477/3175] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:36.053254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:36.053800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:36.060442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.060937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.061422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.062124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.062641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.063078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.122946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:36.130986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c4dee58-3ac7-4567-b7cd-1bc938ec8ac6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081728 Sep 11 05:57:36.131552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1699/3176] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:36.578571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:36.579242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:36.585196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.585680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.586120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.586813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.587268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.587695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.713770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:36.720509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:36.721161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:36.722633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab609ac0-128f-40e5-a67f-75fecefb17cf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148655 Sep 11 05:57:36.723208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1478/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:36.727668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.728193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.728636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.729331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.729797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.730228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.859104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:36.867251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0175e2a-0d1a-4c6f-b8d8-791ce0393916 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150557 Sep 11 05:57:36.867815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1700/3178] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:36 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:36.909722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:36.910337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:36.916754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.917239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.917679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:36.918410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:36.918907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:36.919331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.050055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:37.058118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11523bd3-76a0-4396-9e24-a424d1f55a69 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152271 Sep 11 05:57:37.058690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1479/3179] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:37.153746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:37.154295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:37.160248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.160732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.161168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.161852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.162308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.162735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.226482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:37.235525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-437b8a16-ad65-42cb-ac16-66f71947f6f0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085671 Sep 11 05:57:37.236103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1701/3180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:37.746350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:37.747172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:37.753097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.753571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.754003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.754685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.755132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.755554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.883549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:37.890086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:37.890704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:37.891919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94f828a2-7a43-4f16-adbf-d4c291663a3f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149473 Sep 11 05:57:37.892804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1480/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:37.897750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.898235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.898673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:37.899372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:37.899828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:37.900282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.029749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:38.037938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0164efa-128a-4377-87b4-596a841798bb tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151873 Sep 11 05:57:38.038502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1702/3182] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:37 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:38.081764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:38.082408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:38.088704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.089192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.089636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.090953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.091521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.091957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.220625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:38.228771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d856c4d-762b-4448-9d6d-58620d7171ce tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150902 Sep 11 05:57:38.229338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1481/3183] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:38.259043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:38.259652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:38.266103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.266580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.267014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.267958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.268443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.268869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.329171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:38.337181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06ae88e6-1779-420d-a717-ae95181b442b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081929 Sep 11 05:57:38.337739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1703/3184] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:38.915255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:38.915859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:38.922374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.922852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.923285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:38.923964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:38.925012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:38.925012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.053787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:39.061340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:39.061958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:39.062667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c821c80-6e86-4a61-aad6-1f7d96531f8a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151189 Sep 11 05:57:39.063239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1482/3185] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:39.068162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.068645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.069084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.069783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.070271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.070703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.201049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:39.209309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b02c5533-9919-4b66-a8e4-cd2c5ce31435 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152437 Sep 11 05:57:39.209872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1704/3186] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:39.252837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:39.253443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:39.259708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.260225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.260662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.261344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.261794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.262808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.360118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:39.360756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:39.366581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.367068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.367508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.368229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:39.368687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:39.369114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:39.393993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:39.402203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1377eb01-d6d6-4b74-a368-8ce6825ccb1a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153117 Sep 11 05:57:39.402801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1483/3187] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:39.430448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:39.439106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6667975-822d-4bff-a963-f175a390a0df tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082885 Sep 11 05:57:39.439666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1705/3188] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:40.086399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:40.087026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:40.093598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.094091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.094537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.095231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.095691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.096157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.221348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:40.229572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f283352-aeca-4cb2-bb32-8ea0f545b5d7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147059 Sep 11 05:57:40.230137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1484/3189] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:40 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:40.232430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:40.233101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:40.239507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.240082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.240550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.241230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.241685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.242112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.370207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:40.378681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-227a8c52-c9ce-47cf-866c-eddd1996fe81 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150387 Sep 11 05:57:40.379256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1706/3190] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:40.425267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:40.425887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:40.432317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.432809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.433262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.434149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.434795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.435243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.462238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:40.462954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:40.470100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.470708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.471152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.471845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:40.472326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:40.472758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:40.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:40.548533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d3a38f2-606b-4d3c-a081-9fc137b2174e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090111 Sep 11 05:57:40.549105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1707/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:40.571651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:40.580422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-672355ac-6dd2-43a5-944b-7f6eb9053f25 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158942 Sep 11 05:57:40.580995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1485/3192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:41.252820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:41.253445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:41.259939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.260457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.260906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.261599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.262789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.263222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.389620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:41.391834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:41.399655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae972a3a-c1fd-4bdc-820c-8b7d1cf036d5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150675 Sep 11 05:57:41.400235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1708/3193] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:41.402449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:41.403156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:41.409193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.409737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.410257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.411011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.411536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.411966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.542025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:41.550203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aec4f70d-eff6-40d5-92ec-d1c249ee235d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151901 Sep 11 05:57:41.550781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1486/3194] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:41.570550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:41.571182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:41.578088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.578566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.578996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.579679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.580169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.580594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.603632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:41.604286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:41.610415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.610903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.611351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.612089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:41.612556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:41.612989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:41.642131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:41.651500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff2c50ea-7eb3-42c4-9c9d-d19e8120120d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084755 Sep 11 05:57:41.652088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1709/3195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:41.743286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:41.752087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50b37365-d482-4df2-9043-56d9c18aa61a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152269 Sep 11 05:57:41.752655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1487/3196] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:42.423656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:42.424291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:42.430666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.431142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.431574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.432289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.432740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.433160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.564195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:42.572525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fecba70b-2eeb-4fe9-a6f5-fc3c22cb96b8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152703 Sep 11 05:57:42.573093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1710/3197] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:42.573351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:42.575094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:42.581481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.581967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.582412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.583154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.583617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.584070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.675012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:42.675559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:42.681669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.682399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.682842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.683548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.684666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.685156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.724359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:42.733186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93e6f553-9fa6-4977-a7f2-66071083c439 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.163621 Sep 11 05:57:42.733756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1488/3198] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:42 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:42.760118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:42.768806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97c6f262-7239-4e9b-a160-ce0a3af1a3f4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.097966 Sep 11 05:57:42.769716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1711/3199] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:42.774656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:42.775298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:42.781211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.781704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.782176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.783075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:42.783539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:42.784348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:42.915567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:42.924373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d98e351c-2cdd-4967-beb5-d0ad7a469a1c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153570 Sep 11 05:57:42.924935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1489/3200] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:43.597113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:43.597806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:43.604246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.604734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.605175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.605948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.606401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.606828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.733644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:43.741811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8caa749f-dc11-43aa-9cfe-dd179b46d7bb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148642 Sep 11 05:57:43.742374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1712/3201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:43.756773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:43.757382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:43.764011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.764509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.764945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.765637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.766091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.766517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.791680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:43.792399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:43.798996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.799489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.799961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.800701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.801152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.801581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.866830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:43.875457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0bff3a3b-c3a5-4bc4-a153-eb220a7d2419 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087536 Sep 11 05:57:43.876055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1713/3202] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:43.895454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:43.904150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-87f05ce5-3d9d-4f44-b10b-9e45570c3c6c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151136 Sep 11 05:57:43.904713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1490/3203] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:43 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:43.947341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:43.947960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:43.954702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.955183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.955628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:43.956348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:43.956806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:43.957232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.082099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:44.091024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d45ea1b-2db2-4c72-97f8-be9192954ae6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.146689 Sep 11 05:57:44.091591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1714/3204] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:44.765254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:44.765959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:44.772711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.773198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.773640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.774335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.774790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.775220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.898419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:44.899197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:44.906202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.906774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.907272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.908078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.908535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.908957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.910684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:44.919591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59351112-3d93-4fa7-9fdb-4cb02b5c76cb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.158360 Sep 11 05:57:44.920207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1491/3205] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:44.927870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:44.928514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:44.934960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.935448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.935887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.936615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:44.937067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:44.937493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:44.940134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:44.972664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:44.981500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe143293-4cd7-456c-aa0f-2476a9a0a2f7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086929 Sep 11 05:57:44.982377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1715/3206] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:45.067829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:45.077041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0c08b60-f570-4ef5-a906-d30d923245fe tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152782 Sep 11 05:57:45.077604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1492/3207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:44 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:45.114497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:45.115121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:45.121651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:45.122315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:45.122768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:45.123467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:45.123929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:45.124392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:45.252934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:45.261131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a2e7807-f0ad-41cc-bc31-4330a98c3e78 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150486 Sep 11 05:57:45.262316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1716/3208] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:45.943746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:45.944392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:45.950971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:45.951454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:45.951895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:45.952613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:45.953069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:45.953494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.004414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:46.005036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:46.011543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.012062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.012519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.013228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.013692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.014124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.077548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:46.085470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:46.086147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e51b2df2-0bf5-46c7-8458-779cb6e7ddff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085663 Sep 11 05:57:46.086734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1717/3209] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:46.094325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a01857e7-b4c8-4af3-862b-b50146a86a06 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154452 Sep 11 05:57:46.095024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1493/3210] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:46.100562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:46.101201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:46.107559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.108052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.108484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.109166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.109621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.110037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.236523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:46.244623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07c700f6-ff39-44f4-b90b-d326d500e4d6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147693 Sep 11 05:57:46.245188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1718/3211] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:46.284991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:46.285611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:46.291379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.291864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.292335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.293074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:46.293580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:46.294017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:46.420057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:46.428183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad713e88-0537-4d13-b5f0-71206d57d720 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.146968 Sep 11 05:57:46.428745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1494/3212] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:47.110259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:47.110873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:47.117350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.117834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.118036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:47.118466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.118647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:47.118951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.119408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.119836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.126033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.126509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.126943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.127630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.128102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.128531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.185255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:47.193447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-229cf08a-b858-4c20-af9d-22df7c4024a4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087137 Sep 11 05:57:47.194037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1719/3213] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:47.261692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:47.267244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:47.268228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:47.270611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05c82c5b-0ee3-49e8-a71e-35dd799c948a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156416 Sep 11 05:57:47.271188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1495/3214] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:47 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:47.274457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.274938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.275375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.276090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.276548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.276980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.403606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:47.411921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e29a159d-f6d2-4fd3-8a54-44b879341fee tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148792 Sep 11 05:57:47.412519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1720/3215] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:47.450715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:47.451333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:47.457259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.457745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.458184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.458875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:47.459335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:47.459766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:47.585166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:47.595849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-65a21b50-e0c1-4ff6-a66e-9b2eeed56456 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149079 Sep 11 05:57:47.596447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1496/3216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:47 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:48.216303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:48.216913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:48.223374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.223859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.224336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.225030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.225489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.225920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.287778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:48.293582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:48.294202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:48.296062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f62ce292-450d-45e3-8bff-47378236ddd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083664 Sep 11 05:57:48.296635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1721/3217] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:48.300855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.301366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.301812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.302519 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.302981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.303415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.430713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:48.435402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:48.436070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:48.440288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1744c260-dd43-42b2-8649-bc17909e1596 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150495 Sep 11 05:57:48.441032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1497/3218] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:48 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:48.442061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.442549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.442981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.443669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.444148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.444572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.574927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:48.583183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18954e01-5f97-49eb-bec8-c0a6f3914d27 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152441 Sep 11 05:57:48.583751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1722/3219] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:48 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:48.619759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:48.620401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:48.626325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.626809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.627249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.627941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:48.628434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:48.628865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:48.759555 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:48.768540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-19f8fc4e-b853-47ad-8985-83ee7404a18b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152606 Sep 11 05:57:48.769104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1498/3220] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:49.318960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:49.319599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:49.321903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:49.327639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.328215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.328653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.329340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.329794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.330217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.391646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:49.400179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-81eb75b8-c2e3-4999-9b81-071485dd0644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085036 Sep 11 05:57:49.400745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1723/3221] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:49.463965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:49.464604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:49.471069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.471550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.471989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.472700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.473160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.473589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.602001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:49.606721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:49.607341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:49.610737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8e309bf-5dd1-4981-8e2e-5ac7f7c2e960 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150575 Sep 11 05:57:49.611313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1499/3222] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:49.613342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.613834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.614278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.614986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.615444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.615878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.740829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:49.749066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90947d41-21ae-4b74-b444-79964c5f6b26 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147014 Sep 11 05:57:49.749632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1724/3223] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:49.792159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:49.792797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:49.799650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.800165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.800602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.801338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:49.801740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:49.802161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:49.931345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:49.939614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c95dd13-69bd-4540-a22f-229e836aa86a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151331 Sep 11 05:57:49.940294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1500/3224] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:50.423457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:50.424144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:50.430619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.431104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.431550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.432276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.432742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.433175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.448855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:50.501845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:50.509939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff2dd59e-5d14-4f18-b792-f0a7a6f2535b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090370 Sep 11 05:57:50.510505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1725/3225] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:50.633694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:50.634325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:50.641441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.641922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.642356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.643298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.643750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.644206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.772245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:50.772410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:50.772866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:50.779164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.779680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.780151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.780627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-678c6195-3e93-4f5d-bf95-56b9e1ab66ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150790 Sep 11 05:57:50.780839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.781177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1501/3226] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:50.781306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.781698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.909983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:50.918639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41223b53-bdc9-48eb-ae02-6c993bdbbc41 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149717 Sep 11 05:57:50.919202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1726/3227] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:50 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:50.962526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:50.963140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:50.969070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.969556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.970053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:50.970696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:50.971157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:50.971590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.098853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:51.107898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef351ff9-501c-471d-90a2-33788734552d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149185 Sep 11 05:57:51.108491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1502/3228] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:51.534619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:51.535180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:51.541645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.542134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.542579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.543274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.543737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.544211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.605017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:51.613420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-919f5b15-7ec7-4900-a274-b6d930e42230 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082798 Sep 11 05:57:51.613980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1727/3229] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:51.804544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:51.805066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:51.807478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=98 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:51.814138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.814622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.815062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.815786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.816271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.816700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.941355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:51.942140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:51.948199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:51.948363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.948796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.949238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.949936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:51.950424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:51.950916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:51.956731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6cb87a9a-30ef-4b3f-af77-5bb6477b1a67 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156094 Sep 11 05:57:51.957288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1503/3230] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:52.081242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:52.089502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af06e71a-a6b7-4eb5-bdfa-6f6c5d12b378 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152025 Sep 11 05:57:52.090074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1728/3231] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:51 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:52.130824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:52.131439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:52.137366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.137852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.138342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:52.139075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.139530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.139961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:52.264668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:52.273061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-050b54ae-99c0-4c85-a0fb-6a767951d976 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.146051 Sep 11 05:57:52.273626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1504/3232] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:52 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:52.637185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:52.637812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:52.645434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.645925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.646369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:52.647066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.647528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.647962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:52.709034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:52.717535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fecadf41-6415-4783-b143-59d1921ec889 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084246 Sep 11 05:57:52.718093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1729/3233] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:52.980898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:52.981434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:52.988694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.989180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.989625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:52.990317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:52.990776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:52.991214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.114077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:53.114701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:53.120631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.121111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:53.121261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.121553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.122254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.123291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.123743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.130241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f99647c7-1e74-4f62-850e-814fb40fba76 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153264 Sep 11 05:57:53.130828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1505/3234] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:53.250508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:53.258645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b3419bb-ef4f-405f-93c1-63a2ab520a9a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148444 Sep 11 05:57:53.259202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1730/3235] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:53.297552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:53.298162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:53.304015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.304489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.304919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.305594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.306042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.306460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.432090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:53.440241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41b654a2-44f4-448f-a301-92bed6121ed0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147252 Sep 11 05:57:53.440805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1506/3236] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:53.739780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:53.740424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:53.746823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.747309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.747756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.748471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:53.748927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:53.749355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:53.813895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:53.822112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da98d078-da01-4551-9e64-50d483a6874b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086208 Sep 11 05:57:53.822673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1731/3237] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:54.153923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:54.154540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:54.160980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.161486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.161909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.162598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.163052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.163477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.281205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:54.281933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:54.287881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.288411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.288880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.289583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.290043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.290475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.293704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:54.301907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34b6a48b-acae-4ae6-a879-5ab85ff14f51 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151880 Sep 11 05:57:54.302480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1507/3238] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:54 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:54.417653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:54.426614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05b87e36-c6be-4f80-a834-2a401f0b0e99 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149279 Sep 11 05:57:54.427183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1732/3239] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:54 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:54.463892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:54.464525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:54.471122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.471597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.472056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.472740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.473191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.473614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.600453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:54.602601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:57:54.609877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1664b63c-70dd-42c5-8538-e450ade8e4d7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149797 Sep 11 05:57:54.610447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1508/3240] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:54.845618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:54.846226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:54.853237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.853719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.854149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.854861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:54.855310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:54.855732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:54.918301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:54.926666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69f3cdac-6956-4b91-b0c4-f010e76e3dc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085241 Sep 11 05:57:54.927223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1733/3241] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:55.326422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:55.327152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:55.333672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.334148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.334583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.335270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.335719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.336172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.450471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:55.451120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:55.457164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.457657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.458097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.458805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.459264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.459697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.463591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:55.471868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e58eb12b-1fc9-48fb-bf6b-4f712e2e2fd4 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150057 Sep 11 05:57:55.472499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1509/3242] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:55.589447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:55.598339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d87ccd6f-52ad-4ff6-8148-5e79f314212d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151738 Sep 11 05:57:55.598909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1734/3243] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:55.633463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:55.634079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:55.640393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.640873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.641328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.642003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.642729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.643153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.772639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:55.781502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fcbe4fef-b2b1-43d5-9300-e40e69e90fba tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151914 Sep 11 05:57:55.782081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1510/3244] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:55.950107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:55.951231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:55.957668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.958151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.958584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:55.959265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:55.959716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:55.960173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.022391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:56.031574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f1cebe5-e861-473f-959a-6341d1c1cfdc tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085237 Sep 11 05:57:56.032052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1735/3245] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:56.495145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:56.495761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:56.503274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.503762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.504234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.504934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.505391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.505820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.621221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:56.621842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:56.628260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.628747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.629192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.629892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.630350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.630777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.631989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:56.640252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c65a01f0-15ce-426a-a4ae-dea6f8713b7f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148968 Sep 11 05:57:56.640829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1511/3246] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:56.765046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:56.773724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de2a3acb-cfec-4998-8e75-91484ed5cfd6 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156384 Sep 11 05:57:56.774291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1736/3247] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:56.804913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:56.805564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:56.811714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.812244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.812689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.813393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:56.813857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:56.814285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:56.946267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:56.954907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36e13709-8791-4c68-9159-5b70b21ed2a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153902 Sep 11 05:57:56.955477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1512/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:57.054483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:57.055030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:57.062364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.062846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.063281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.063968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.064448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.064875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.128822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:57.137004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a6d4f30-6a78-41df-ba93-1dd40609c988 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086446 Sep 11 05:57:57.137572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1737/3249] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:57.664331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:57.664936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:57.672024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.672504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.672938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.673635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.674086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.674508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.803557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:57.806831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:57.807708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:57.811758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1d68fa0-178c-4642-be30-31fce5bf3ebf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151413 Sep 11 05:57:57.815272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1513/3250] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:57.815454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.815454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.815749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.816651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.817213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.817716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.978888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:57.979581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:57.986261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.986762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.987192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:57.987903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:57.988392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:57.988820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:58.124623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:58.132766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e888a940-590b-445d-9d74-6f0abdd6b855 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157915 Sep 11 05:57:58.133528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1514/3251] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:57 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:58.160276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:58.161039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:58.166993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:58.167479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:58.167911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:58.168734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:58.169729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:58.170358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:58.187390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:58.195628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0ccea5b-c7e1-47d4-b481-d536478cc8a0 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.392606 Sep 11 05:57:58.196222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1738/3252] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:57 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:58.235513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:58.243738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1baf784e-b128-4e32-bdb8-879e4ad95c77 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087364 Sep 11 05:57:58.244338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1515/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:58.834782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:58.835432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:58.841397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:58.842031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:58.842470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:58.843150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:58.843598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:58.844053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:58.971128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:58.979314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cfb9259-83a2-44d4-9c5a-cea8a6adc879 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148528 Sep 11 05:57:58.979875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1739/3254] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:59.156509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:59.157123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:59.163513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.164011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.164459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.165149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.165605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.166031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.218707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:59.219300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:59.225231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.225717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.226156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.226854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.227309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.227734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.292177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:59.301399 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3d5a14b-4995-4444-9c39-0a9d6185939b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149020 Sep 11 05:57:59.301973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1516/3255] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:57:59.306516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:57:59.307114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:57:59.313737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.314227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.314663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.315350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:57:59.315808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:57:59.316259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:57:59.361757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:59.369997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc6625b9-a277-4794-a576-20cfe2ec431c tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155245 Sep 11 05:57:59.370588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1740/3256] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:57:59.378758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:57:59.386799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99dcf2f8-a450-4590-a105-25a638c67a5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083855 Sep 11 05:57:59.387352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1517/3257] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:00.002107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:00.002722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:00.009283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.009769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.010209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.010897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.011352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.011777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.141016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:00.149543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fedb7ba7-8091-4f71-9496-e373f6b7fc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151343 Sep 11 05:58:00.150107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1741/3258] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:57:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:00.325221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:00.326448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:00.332463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.332947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.333383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.334103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.334557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.334983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.394355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:00.395063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:00.401098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.401588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.402028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.402722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.403178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.404383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.408702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:00.477765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:00.485925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a02bbdbb-a3ca-47b5-8275-bf5b0073d580 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.164521 Sep 11 05:58:00.486495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1518/3259] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:00.490962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:00.491810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:00.499688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.500232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.500677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.501382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:00.501842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:00.502264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:00.552027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:00.561047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46f988b4-ffff-4297-92fb-7f8e4ee0b6f2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.170940 Sep 11 05:58:00.561715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1742/3260] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:00.565622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:00.573843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b54b2d3f-ade0-46d4-80ee-c4e5c97289eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086405 Sep 11 05:58:00.574518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1519/3261] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:01.173307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:01.173930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:01.180445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.180934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.181377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.182071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.182536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.182968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.312368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:01.318561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-177d4e99-67a3-4a68-a809-a49cbf36abb2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149226 Sep 11 05:58:01.319123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1743/3262] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:01 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:01.511614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:01.512188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:01.519592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.520108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.520549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.521238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.521693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.522124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.585255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:01.585846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:01.591645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.592181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.592704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.593424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.594044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.594468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.648886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:01.657232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3587c4f-28b2-42ee-a4ed-34adb617e1a3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149456 Sep 11 05:58:01.657946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1520/3263] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:01 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:01.662565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:01.663166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:01.669854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.670554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.671192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.672617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:01.673265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:01.673706 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:01.726632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:01.735672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a581b013-7b14-4904-b0fe-81999839ab95 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154297 Sep 11 05:58:01.736454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1744/3264] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:01 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:01.739029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:01.747954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe510285-6cd7-4830-a2d4-a854376517a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088349 Sep 11 05:58:01.748544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1521/3265] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:02.343426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:02.344010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:02.350522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.351006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.351444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.352196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.352654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.353080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.481790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:02.490089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa7f6511-5678-4d34-80b7-5a356dbdb5ad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151283 Sep 11 05:58:02.490662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1745/3266] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:02.681418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:02.681958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:02.688996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.689474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.689910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.690594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.691050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.691471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.759281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:02.759927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:02.767034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.767034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.767709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.768486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.768904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.769330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.822443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:02.830795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc417ade-28a2-4641-9406-5e9e4052a8a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153306 Sep 11 05:58:02.831366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1522/3267] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:02.835854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:02.836482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:02.843499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.844009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.844458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.845163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:02.845650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:02.846080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:02.902683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:02.909374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:02.911905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e03bc2a0-a124-41cc-95ec-dbeb975d990b tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157048 Sep 11 05:58:02.912719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1746/3268] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:02.917677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aaf031cc-5396-4e26-a417-3fc51d5670a7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085365 Sep 11 05:58:02.918323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1523/3269] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:03.514079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:03.514620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:03.521336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.521820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.522254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:03.522971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.523425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.523846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:03.661925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:03.671558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22a147ae-a69f-4689-a921-92f952964ad9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.161762 Sep 11 05:58:03.672171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1747/3270] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:03.853684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:03.854329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:03.861131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.861631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.862079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:03.862790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.863251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.863680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:03.934716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:03.935365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:03.941336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.941862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.942300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:03.943004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:03.943463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:03.943892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:04.063092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:04.072329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08a270ef-54c6-4528-9c9a-f09868406747 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.222481 Sep 11 05:58:04.072913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1524/3271] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:04.083787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:04.083787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:04.084041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:04.085710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:04.086380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:04.086700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:04.087445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:04.087904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:04.088361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:04.089520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39bc8aec-0055-4d2d-be62-58fe43d0f9b4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158679 Sep 11 05:58:04.090100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1748/3272] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:03 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:04.104638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:04.151397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:04.160307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d165c630-18ca-4c8f-b3d3-5acafc9c9070 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086413 Sep 11 05:58:04.160886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1525/3273] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:04.694609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:04.695226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:04.701754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:04.702236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:04.702676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:04.703363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:04.703855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:04.704317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:04.835625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:04.844167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2b857bd-c6bf-4446-8aed-807ea2762c1c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153357 Sep 11 05:58:04.844733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1749/3274] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:05.096616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:05.097240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:05.103787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.104300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.104747 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.105445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.105904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.106342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.113369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:05.113977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:05.119834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.120353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.120788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.121474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.121926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.122552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.239588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:05.247916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45a3c2e6-00b8-4ccd-9d82-6cab8bada746 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154956 Sep 11 05:58:05.248523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1526/3275] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:05 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:05.260205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:05.260205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:05.260562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:05.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.260677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.260980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.261438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.262309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.262885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1824ab3-2674-497a-a721-33bf6fa5a947 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153123 Sep 11 05:58:05.263678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1750/3276] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:05 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:05.323294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:05.331916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-952bbf3d-dffd-4707-b06f-a61611199b3c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082448 Sep 11 05:58:05.332508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1527/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:05.867853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:05.868510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:05.875490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.875975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.876440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:05.877129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:05.877587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:05.878012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.039465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:06.039465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ce42ef6-5bee-47e6-a169-1b8024cc563a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153756 Sep 11 05:58:06.039465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1751/3278] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:06.274029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:06.274564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:06.281253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.281738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.282178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.282865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.283315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.283735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.286553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:06.287173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:06.293054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.293545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.294537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.295281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.295752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.296209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.428981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:06.437970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d700b9f-9ffd-4cc1-b710-f6a26b54fed5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155186 Sep 11 05:58:06.438542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1752/3279] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:06 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:06.443217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:06.443832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:06.449655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.450181 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.450708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.451403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:06.451863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:06.452328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:06.469599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:06.477769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aefb4989-8eca-4008-85bf-abe8d173f136 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.207753 Sep 11 05:58:06.478334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1528/3280] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:06.513726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:06.522075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79946638-6ae7-48a9-9bbe-8b6deb0c3097 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082593 Sep 11 05:58:06.522639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1753/3281] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:07.041149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:07.041764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:07.047749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.048276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.048718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.049406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.049863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.050289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.178886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:07.188110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f41736da-79be-4509-b798-d9b4f7c1470c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150817 Sep 11 05:58:07.188680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1529/3282] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:07.461713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:07.462261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:07.468773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.469257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.469715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.470406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.470857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.471282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.502575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:07.503181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:07.509558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.510034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.510470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.511155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.511606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.512068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.609939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:07.620943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf6dd9c6-e8c9-4e26-b81b-50ec024499c9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.163120 Sep 11 05:58:07.621523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1754/3283] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:07 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:07.626856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:07.627459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:07.633413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.634089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.634707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.635464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:07.636114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:07.636709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:07.645116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:07.653807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed15d59e-0b7e-43b4-86e9-4b5cc83f3a97 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154719 Sep 11 05:58:07.654642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1530/3284] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:07 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:07.698206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:07.706513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50cc0d3d-3e72-4c18-9718-d308cafd98aa tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083337 Sep 11 05:58:07.707101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1755/3285] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:08.211581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:08.212227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:08.218400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.218882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.219320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.220047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.220506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.220946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.348698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:08.357340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea0687bc-dfbf-4dee-8ca5-5e0db2dfac5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149591 Sep 11 05:58:08.357903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1531/3286] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:08 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:08.645159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:08.645774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:08.652192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.652683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.653122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.653833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.654293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.654721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.677582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:08.678303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:08.685159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.685654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.686172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.686872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.687356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.687783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.784520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:08.797849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30fa6f80-d875-452e-831d-bd2a05c7d2ff tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156696 Sep 11 05:58:08.798525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1756/3287] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:08 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:08.807290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:08.807908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:08.813852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.814343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.814778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.815476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:08.815933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:08.816392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:08.821554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:08.830841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9be739a-37b3-4756-88da-69aff75359a7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157026 Sep 11 05:58:08.831436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1532/3288] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:08 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:08.886446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:08.895139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-123c43f7-b060-40be-ac13-eef990b5fb3e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.095488 Sep 11 05:58:08.895840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1757/3289] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:09.379894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:09.380553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:09.386477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.386966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.387406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.388205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.388664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.389098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.516164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:09.524515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-678a2030-2557-467c-8263-75593d1f6a49 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148491 Sep 11 05:58:09.525097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1533/3290] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:09 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:09.821671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:09.822286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:09.829479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.829963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.830400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.831090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.831547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.831970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.854568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:09.855182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:09.862276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.862753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.863186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.863876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.864359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.864781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.968206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:09.970399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:09.978089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e0e78fd-0808-4a2d-8584-03307d46ad74 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.160206 Sep 11 05:58:09.992199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1758/3291] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:09 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:09.992199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:09.992199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:09.992199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.992199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.992626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:09.992710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:09.993151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:09.993575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:10.005201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:10.014653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51a5f328-05ba-4fe0-ade7-62502bf36b2b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.163900 Sep 11 05:58:10.015238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1534/3292] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:09 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:10.055830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:10.064671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb5b9581-5c5a-4af6-a13a-0bed685fefa0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084421 Sep 11 05:58:10.065229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1759/3293] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:10.547609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:10.548237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:10.554107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:10.554588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:10.555020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:10.555732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:10.556221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:10.556642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:10.686980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:10.695140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd246da3-7672-43c0-a528-70e20567a188 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152309 Sep 11 05:58:10.695714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1535/3294] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:10 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:11.003378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:11.003987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:11.010675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.011163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.011603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.012318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.013416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.013841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.038252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:11.038871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:11.045327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.045818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.046260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.046961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.047420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.047849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.146503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:11.155095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcde0801-2989-45f2-8d21-f66a0721c772 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155560 Sep 11 05:58:11.155673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1760/3295] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:10 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:11.160242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:11.160851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:11.166507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.167002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.167441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.168164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.168620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.169252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.183153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:11.192064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0097a6a7-ea9f-44b7-98cf-9c527c5a3b6f tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.157577 Sep 11 05:58:11.192637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1536/3296] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:11 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:11.230649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:11.239655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aae9e5d8-007f-4644-b117-2142f24550ff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082945 Sep 11 05:58:11.240273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1761/3297] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:11.719890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:11.720525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:11.726471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.726950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.727385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.728089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:11.728574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:11.728995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:11.854819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:11.863775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb8c3376-684c-4a77-b324-1dfa3ce75174 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148296 Sep 11 05:58:11.864388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1537/3298] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:11 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:12.178676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:12.179290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:12.186286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.186763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.187200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.187938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.188420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.188846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.214700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:12.215404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:12.223079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.223563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.224032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.224724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.225175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.225594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.318180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:12.326754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e933b357-4916-444d-9ad5-e71436fbb57d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151971 Sep 11 05:58:12.327332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1762/3299] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:12 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:12.332151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:12.332766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:12.338441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.338936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.339379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.340106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.340596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.341168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.357195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:12.365531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-321c58ce-6017-4392-a112-f436319b58d3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154632 Sep 11 05:58:12.366119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1538/3300] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:12 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:12.404890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:12.413579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edf83926-2b49-470a-9dbc-ecfafe88d566 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084998 Sep 11 05:58:12.414144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1763/3301] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:12.887123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:12.888258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:12.894508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.894992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.895428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:12.896149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:12.896604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:12.897030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.022349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:13.030427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bc88c732-4ff5-4a29-ab53-74873efb8de7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147286 Sep 11 05:58:13.030991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1539/3302] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:12 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:13.349715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:13.350336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:13.357544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.358028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.358470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.359169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.359634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.360097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.390345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:13.391099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:13.397879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.398443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.398886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.399585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.400061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.400490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.491844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:13.500218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-567eb035-c4ab-4d10-b2dd-39bdbf07349d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154273 Sep 11 05:58:13.500998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1764/3303] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:13 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:13.505188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:13.505791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:13.511502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.511986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.512517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.513368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:13.513831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:13.514609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:13.529481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:13.537680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-70231138-d2d2-4632-82d2-f2c2bbbfcd90 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151260 Sep 11 05:58:13.538257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1540/3304] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:13 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:13.575963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:13.584630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fc8da66-aa8c-495f-9a50-13b172fec4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082892 Sep 11 05:58:13.585194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1765/3305] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:14.053980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:14.054587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:14.061274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.061699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.062135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.062821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.063272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.063693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.192324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:14.201249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3445361-9de3-415a-a61d-8119037a93fe tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150219 Sep 11 05:58:14.201841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1541/3306] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:14 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:14.523595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:14.524239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:14.530903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.531386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.531822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.532553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.533008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.533435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.561547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:14.562159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:14.568597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.569083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.569524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.570227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.570691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.571126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.575089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:14.669820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:14.678363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4785ac38-d0aa-4cc4-b8c9-3ff463b5b4e5 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.158618 Sep 11 05:58:14.679023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1766/3307] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:14 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:14.683632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:14.684874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:14.690648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.691141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.691579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.692296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:14.692758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:14.693187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:14.701121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:14.709189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb0b2be3-1c45-48f7-8985-992fc013eedc tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152136 Sep 11 05:58:14.709762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1542/3308] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:14 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:14.755526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:14.764038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e02a3c89-ff44-4405-a74a-ef37a24124db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084038 Sep 11 05:58:14.764606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1767/3309] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:15.224748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:15.226260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:15.231639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.232159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.232594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.233280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.233726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.234148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.364571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:15.372585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ac435c01-f7b3-46dd-bcfc-c2786eec2073 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151789 Sep 11 05:58:15.373142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1543/3310] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:15 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:15.701130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:15.701780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:15.712506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.717367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.717811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.718507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.718967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.719402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.733667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:15.734305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:15.740748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.741245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.741691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.742396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.742858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.743290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.857631 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:15.865884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cdcc573-c06a-42f5-aa3f-60bbaa04b51d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.168653 Sep 11 05:58:15.866466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1768/3311] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:15 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:15.870915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:15.871536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:15.876962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:15.877567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.878067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.878509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.879217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:15.879678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:15.880135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:15.885523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d48a3597-2473-4483-8f29-b2b5aa65977d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156487 Sep 11 05:58:15.886084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1544/3312] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:15 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:15.941225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:15.949342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-750e4178-0616-4454-8725-d381babdbfb3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081895 Sep 11 05:58:15.950843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1769/3313] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:16.396120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:16.396728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:16.402654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.403214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.403647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:16.404348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.404802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.405222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:16.531814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:16.539927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5d804b84-f4e5-4f34-bfbf-1b856c46c20a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147944 Sep 11 05:58:16.540520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1545/3314] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:16 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:16.889911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:16.890531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:16.897254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.897735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.898175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:16.898861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.899320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.899743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:16.909960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:16.910572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:16.916842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.917323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.917767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:16.918461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:16.919433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:16.919857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.033632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:17.041882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebe144e5-7d4f-48e9-9dba-37d8a24e04a7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155807 Sep 11 05:58:17.042791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1770/3315] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:16 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:17.047599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:17.048244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:17.053500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:17.054146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.054644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.055089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.055845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.056283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.056716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.063206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5eb34e3-676a-47c1-864c-04625371b093 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156988 Sep 11 05:58:17.063871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1546/3316] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:16 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:17.117826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:17.126495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b57fba42-69a2-4ef9-88de-ff277e74ad6a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083104 Sep 11 05:58:17.127062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1771/3317] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:17.563659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:17.564308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:17.570654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.571151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.571589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.572310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.572764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.573187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.718367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:17.726480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05112967-10a9-4fb7-9292-9f64fc4f4689 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.167408 Sep 11 05:58:17.728033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1547/3318] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:17 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:17.803503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:17.804384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:17.811710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.812690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.813541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.814925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:17.815815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:17.816687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:17.846105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1bc2db4-0b20-474d-9307-b99865a7e5b2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/ips" status: 200 len: 151 microversion: 2.20 time: 0.050337 Sep 11 05:58:17.846703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1772/3319] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Sep 11 05:58:17 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 05:58:18.066118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:18.067138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:18.074655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.076479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.076922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.078838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.079302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.080774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.087377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:18.088125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:18.091738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:18.097863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.098353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.098793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.099502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.099970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.100424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.238085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:18.246535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-98b3cccd-5d70-4b0c-bb19-b0aa4dcd0bd9 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.184611 Sep 11 05:58:18.247756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1548/3320] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:18 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:18.252547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:18.253156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:18.259234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.259797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.260263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.261020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.261483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.261909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.263703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:18.273553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd1873d9-6a0c-4ec8-a017-34a94b5394b0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.190154 Sep 11 05:58:18.274143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1773/3321] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:18 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:18.325626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:18.333879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b85c984-6540-407c-99a3-95e9660a09d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084953 Sep 11 05:58:18.334445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1549/3322] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:18.751255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:18.751784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:18.757728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.758208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.758640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.759322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:18.759770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:18.760228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:18.890809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:18.899141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9c50ec2-a933-4654-afda-91a031306c9b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152786 Sep 11 05:58:18.899712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1774/3323] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:18 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:19.271167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:19.271526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:19.277895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.278784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.279245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.279948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.280436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.280859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.297540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:19.298162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:19.304431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.304922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.305360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.306055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.306516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.306943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.410208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:19.418334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b0dd1460-670b-4be1-bf31-b8578cc6271a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151603 Sep 11 05:58:19.420191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1550/3324] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:19 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:19.424760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:19.425527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:19.431051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.431692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.432330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.433179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.433641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.434112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.440126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:19.442425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:19.449921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e21e1369-77ec-4a0e-bc89-bfd9ada95337 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156828 Sep 11 05:58:19.450886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1775/3325] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:19 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:19.502178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:19.510226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae7fa1fc-e8cc-4630-85de-fce96fc881b7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089092 Sep 11 05:58:19.510799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1551/3326] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:19.923067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:19.923673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:19.929584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.930066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.930496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:19.931175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:19.931625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:19.932075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.061627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:20.069722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6a5b339-1f16-41fa-8965-9a4ceda8c72a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151160 Sep 11 05:58:20.070284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1776/3327] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:19 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:20.442712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:20.443322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:20.449750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.450247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.450685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.451369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.451852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.452302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.473670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:20.474439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:20.480718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.482117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.482717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.483416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.483897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.484385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.582744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:20.591629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f2adbcd-dd6c-49ed-91a1-14b7c1410069 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152737 Sep 11 05:58:20.592230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1552/3328] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:20 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:20.604147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:20.604147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:20.604147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:20.604147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.604147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.604544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.604829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:20.605277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:20.605866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:20.615523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:20.624236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9c27f7e-9d0e-4dc0-b170-a2ab408d3dad tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154394 Sep 11 05:58:20.624808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1777/3329] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:20 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:20.669637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:20.677738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41d66f10-f4d5-49e5-9777-d178de72ce29 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084558 Sep 11 05:58:20.678302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1553/3330] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:21.094249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:21.094904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:21.100896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.101378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.101819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.102507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.102963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.103389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.233120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:21.241277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8711072e-2fd3-44a3-a6c5-589817eee2ae tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152441 Sep 11 05:58:21.241842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1778/3331] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:21 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:21.617309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:21.617956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:21.625012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.625497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.625935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.626626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.627083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.627511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.646973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:21.647633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:21.654142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.654632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.655076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.655778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.656267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.656733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.789854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:21.799348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cc59de6-6111-43f5-9043-f2f9b9f7fbfe tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.156403 Sep 11 05:58:21.808716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1779/3332] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:21 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:21.808716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:21.808716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:21.812684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.813185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.813654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.814361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:21.814891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:21.815321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:21.879915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:21.888927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2372e216-1c41-4995-8d9a-d7d4e3fd4618 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087897 Sep 11 05:58:21.889518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1780/3333] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:21.985317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:21.993447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-080b9e2c-84ea-4f4e-ad56-090775a4a5ae tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.380067 Sep 11 05:58:21.994016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1554/3334] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:21 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:22.265599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:22.266125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:22.272326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.272803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.273236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.273916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.274365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.274781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.405995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:22.414364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8afd687d-486c-44b3-b952-43aebeaa7d14 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153474 Sep 11 05:58:22.414924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1781/3335] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:22 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:22.824238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:22.825593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:22.832299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.833340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.833783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.834481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.834942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.835366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.912735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:22.913357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:22.920520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.921013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.921455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.922159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:22.922620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:22.923053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:22.960381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:22.969101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71849ecc-7309-4c32-a43c-460cb912bc37 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149078 Sep 11 05:58:22.969716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1555/3336] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:22 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:22.985850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:22.994146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b860618d-c8ee-40f3-9038-4bf186bd2cbd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085296 Sep 11 05:58:22.994706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1782/3337] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:23.016394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:23.017030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:23.023113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:23.023593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:23.024051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:23.024737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:23.025193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:23.025646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:23.153750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:23.161918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-771da185-62c1-43fe-9f83-16df16242d06 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149416 Sep 11 05:58:23.162487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1556/3338] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:23 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:23.438702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:23.439314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:23.445298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:23.445778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:23.446210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:23.446892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:23.447343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:23.447770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:23.572670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:23.580939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5330c126-ab31-4131-b900-e02be721b1e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.146146 Sep 11 05:58:23.581506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1783/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:23.992132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:23.992762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:23.999946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.000460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.000902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.001592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.002052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.002476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.018177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:24.018797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:24.025300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.025786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.026221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.026939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.027392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.027911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.094357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:24.102677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4812fb0e-74a9-46d6-8773-36aea231e232 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088709 Sep 11 05:58:24.103238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1784/3340] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:24.130969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:24.139324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71b2d500-0a2c-4c35-83ee-6a489e8acab0 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151122 Sep 11 05:58:24.139894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1557/3341] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:23 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:24.185212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:24.185860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:24.191716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.192238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.192684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.193374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.193856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.194283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.323124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:24.331598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-321907b5-623c-4cae-bcbb-ace921819ffc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150306 Sep 11 05:58:24.332137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1785/3342] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:24 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:24.604632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:24.605168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:24.611483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.611949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.612425 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.613109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:24.613562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:24.613984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:24.749304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:24.751428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:24.758420 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d073e933-d53f-4c0f-b712-655d177126a6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.157722 Sep 11 05:58:24.758978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1558/3343] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:24 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:25.125734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:25.126278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:25.132668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.133148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.133582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.134266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.134715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.135135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.163931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:25.164596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:25.171707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.172222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.172666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.173360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.173815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.174240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.197690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:25.206781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5ddd658-f90c-4820-87bf-6d5c84e18094 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085231 Sep 11 05:58:25.207362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1786/3344] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:25.306544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:25.314688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b0224a94-0333-4032-97cc-59bc2a5c53af tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154600 Sep 11 05:58:25.315262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1559/3345] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:25 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:25.354620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:25.355241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:25.361607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.362095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.362539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.363231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.363694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.364158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.494174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:25.502622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45b94d93-8c7c-42d0-9986-21e52f4b7029 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151743 Sep 11 05:58:25.503203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1787/3346] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:25 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:25.782209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:25.782739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:25.788765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.789247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.789690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.790403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:25.790843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:25.791269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:25.918337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:25.926662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-888632f7-aa61-42de-870b-ee1c89ba1bdc tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148616 Sep 11 05:58:25.927218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1560/3347] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:25 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:26.230754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:26.231366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:26.238881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.239392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.239836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.240572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.241034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.241465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.303070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:26.311208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-713e5f83-c40a-4801-a2d4-3dc5c89839fb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084336 Sep 11 05:58:26.311769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1788/3348] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:26.338159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:26.338792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:26.345953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.346427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.346861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.347566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.348036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.348462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.477795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:26.486906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f6c1313e-0cd3-4b3f-89b6-6d3e07c28402 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152595 Sep 11 05:58:26.487473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1561/3349] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:26 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:26.526169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:26.526790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:26.533418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.533908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.534352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.535042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.535503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.535934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.661590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:26.670292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39995daf-61fe-4972-80b4-a8fd7bec35ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147423 Sep 11 05:58:26.671061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1789/3350] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:26 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:26.950385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:26.951114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:26.957224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.957700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.958143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:26.958821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:26.959273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:26.959694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.085390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:27.094717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9146ba38-58e1-424d-a525-5b4a254298ac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148188 Sep 11 05:58:27.095280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1562/3351] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:26 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:27.333507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:27.334096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:27.340488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.340968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.342850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.342850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.343300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.343754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.408991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:27.417269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5361f29-5a8b-49c4-9ddc-a87e47d2e22b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087663 Sep 11 05:58:27.417821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1790/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:27.510648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:27.511255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:27.518553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.519036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.519477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.520213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.520676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.521107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.647176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:27.656089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02b1a995-1270-45d7-b8cf-d3fb2ad1b2ed tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149347 Sep 11 05:58:27.656666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1563/3353] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:27 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:27.693196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:27.693809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:27.699734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.700256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.700700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.701926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:27.702374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:27.702814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:27.830429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:27.838769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d031b3c-395e-4f71-86a8-8455133cc47e tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149393 Sep 11 05:58:27.839337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1791/3354] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:27 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:28.118074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:28.118681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:28.125351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.125826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.126263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.126939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.127416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.127834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.256577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:28.265305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b3f84d8-1a68-4497-8578-1693d045c3d0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151082 Sep 11 05:58:28.265877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1564/3355] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:28 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:28.441077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:28.441621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:28.448082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.448571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.449008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.449697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.450151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.450578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.465389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:28.514260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:28.522590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bd7bf45-6d48-4138-9877-76e807e71ea0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085415 Sep 11 05:58:28.523148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1792/3356] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:28.679446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:28.680082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:28.687013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.687491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.687926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.688644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.689098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.689527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.818744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:28.827662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5aa8e4a-e247-40d3-857d-9613e00c2878 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152121 Sep 11 05:58:28.828278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1565/3357] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:28 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:28.862030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:28.862648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:28.868727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.869217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.869684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:28.870375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:28.870834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:28.871262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.004544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:29.013042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9bfd6a9d-137d-4083-b50b-eca7b9d51619 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.155158 Sep 11 05:58:29.013839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1793/3358] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:28 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:29.289254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:29.289860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:29.296774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.297250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.297684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.298362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.298813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.299232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.428175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:29.436343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b77abc6-21d5-4245-89cd-07edc83addb7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150917 Sep 11 05:58:29.436915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1566/3359] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:29 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:29.546970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:29.547524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:29.553524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.554018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.554463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.555155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.555617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.556073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.620154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:29.628539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5eab52a3-5f76-408a-9a51-f08a7eea6a67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086147 Sep 11 05:58:29.629409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1794/3360] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:29.851103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:29.851720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:29.858290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.858774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.859214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.859909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:29.860410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:29.860865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:29.987578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:29.995798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ebb99d0-31f1-4bd6-b5c5-f46aaf4ac44a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.148579 Sep 11 05:58:29.996388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1567/3361] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:29 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:30.036874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:30.037484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:30.043756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.044260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.044760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.045444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.045893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.046317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.171632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:30.179815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89cc4045-b5ea-479f-b5e0-6d8a9a49c78d tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.146896 Sep 11 05:58:30.180420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1795/3362] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:30 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:30.459847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:30.460491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:30.466489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.466971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.467419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.468144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.468604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.469033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.603515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:30.612352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f6287cc-4647-4f2c-9010-a8ce4c69ea2f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.156268 Sep 11 05:58:30.613014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1568/3363] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:30 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:30.651213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:30.651824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:30.658779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.659266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.659692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.660419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:30.660874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:30.661291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:30.725104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:30.734323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef8bfab6-817f-4f61-8bb5-94a8666114a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087003 Sep 11 05:58:30.734880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1796/3364] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:31.020022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:31.020557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:31.026541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.027018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.027476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.028175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.028631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.029123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.157084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:31.165058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51987c24-1a91-49b3-bbd9-25d98f5e01df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149378 Sep 11 05:58:31.165616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1569/3365] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:31 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:31.202582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:31.203225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:31.209673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.210162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.210605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.211293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.211751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.212208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.339144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:31.347629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f61940f-1a74-4adb-bfd7-317d1e72ca04 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148961 Sep 11 05:58:31.348232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1797/3366] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:31 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:31.636367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:31.637007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:31.643675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.644186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.644756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.645325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.645778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.646203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.757741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:31.758361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:31.764500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.764992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.765433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.766134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:31.766715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:31.767148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:31.776024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:31.785794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8260c632-618e-40f6-aefa-bb4da4f25c70 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153252 Sep 11 05:58:31.786512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1570/3367] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:31 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:31.828858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:31.836912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9b5944d-fd60-4cd3-980a-1cb10bf0274b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083068 Sep 11 05:58:31.837465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1798/3368] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:32.189153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:32.189760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:32.195639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.196150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.196588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.197265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.197716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.198136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.328370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:32.336361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb0ea80e-fe8b-4f20-92a9-1d594ef08ba7 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151376 Sep 11 05:58:32.336919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1571/3369] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:32 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:32.370445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:32.371053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:32.378299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.378786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.379215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.379892 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.380370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.380792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.515365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:32.523716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95ebddda-7412-4bb9-86ce-59dbed4d2bb8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157032 Sep 11 05:58:32.524311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1799/3370] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:32 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:32.809596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:32.811018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:32.817454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.817935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.818367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.819058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.819509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.819934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.861011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:32.861619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:32.868184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.868675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.869111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.869807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:32.870259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:32.870681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:32.934801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:32.944151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9a71215-6360-4a0c-a0db-c99925512345 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087750 Sep 11 05:58:32.944946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1800/3371] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:32.960296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:32.968793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dab1558e-3a8c-470f-a734-93e1b21a50c8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.163043 Sep 11 05:58:32.969377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1572/3372] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:32 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:33.360590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:33.361201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:33.367069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.367550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.368030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.368711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.369161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.369584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.495573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:33.503864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-219bc84d-6003-4abc-88a9-32b4c2bddcf3 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147968 Sep 11 05:58:33.504473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1801/3373] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:33 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:33.547002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:33.547550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:33.553415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.553892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.554329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.555009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.555460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.555914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.688663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:33.696716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad7edd9b-fc0d-4473-b128-5badf39f2405 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154008 Sep 11 05:58:33.697277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1573/3374] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:33 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:33.967661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:33.968304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:33.974272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.974755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.975197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.975881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.976368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:33.976796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:33.991991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:33.992640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:33.999275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:33.999775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.000437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.001141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:34.001602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.002035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.042195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:34.051287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f36e66b2-31cc-449b-92f1-aa0944add223 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088165 Sep 11 05:58:34.051864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1802/3375] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:34.129830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:34.137966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b12ce1a3-600d-4048-bd97-d2922f4ba5ea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.149862 Sep 11 05:58:34.138968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1574/3376] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:33 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:34.528046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:34.529357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:34.535749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:34.536263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.536706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.537406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:34.537846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.538271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.665716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:34.674814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fd25d77-d083-47c5-ad26-f060917ed032 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150646 Sep 11 05:58:34.675367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1803/3377] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:34 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:34.719663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:34.720296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:34.726249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:34.726731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.727189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.727875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:34.728385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:34.728807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:34.744089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:34.858790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:34.867086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b6a4652-af56-46a4-a730-e892056af876 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151821 Sep 11 05:58:34.867596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1575/3378] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:34 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:35.075357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:35.076821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:35.082735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.083245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.083679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.084394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.084846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.085268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.146427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:35.155358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03b571e4-54e6-4ca2-8b47-1363175683a6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083892 Sep 11 05:58:35.155921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1804/3379] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:35.162283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:35.162924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:35.169391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.170022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.170466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.171157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.171613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.172064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.300476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:35.308607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-70162eeb-6ce8-4352-90b3-363ac929f19f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150196 Sep 11 05:58:35.309172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1576/3380] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:35 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:35.698140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:35.698783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:35.705468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.705954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.706389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.707079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.707537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.707964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.841157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:35.849335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3fb3e3f-007c-4ba0-ba75-4d4039cfb50e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155158 Sep 11 05:58:35.849923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1805/3381] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:35 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:35.890311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:35.890851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:35.897102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.897585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.898021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:35.898713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:35.899171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:35.899598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.028193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:36.036822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45f5004f-12da-48b9-8554-e40d5935584a tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150617 Sep 11 05:58:36.037389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1577/3382] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:35 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:36.178222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:36.178790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:36.184695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.185187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.185635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.186326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.186789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.187221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.248601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:36.256848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d13dc98-fe2f-49af-969b-b1dc8cec7681 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082683 Sep 11 05:58:36.257407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1806/3383] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:36.331901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:36.332535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:36.338960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.339442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.339877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.340591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.341047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.342023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.472153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:36.480269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15706dbf-215b-44e4-aac8-5df4111992c2 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152167 Sep 11 05:58:36.480850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1578/3384] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:36 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:36.873792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:36.874391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:36.881091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.881579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.882022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:36.882711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:36.883168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:36.883594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.010795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:37.020188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7c046c2-80ec-4b3b-84a7-dc7f9fb6bd32 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150947 Sep 11 05:58:37.020753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1807/3385] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:36 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:37.060664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:37.061309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:37.067088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.067570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.068023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.068720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.069173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.069598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.196571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:37.205053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccbb4345-ab99-4a93-a170-bcb16ece8160 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148883 Sep 11 05:58:37.205617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1579/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:37 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:37.280738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:37.281368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:37.287214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.287703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.288226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.288924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.289386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.289814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.354225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:37.363170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3acb2ee3-4171-4956-8994-4c67d2afd3b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086930 Sep 11 05:58:37.363737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1808/3387] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:37.502673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:37.503289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:37.509644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.510130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.510572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.511266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:37.511726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:37.512193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:37.652472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:37.663140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b84f8cd6-efd8-4c48-a451-1fc685dbf36c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.164274 Sep 11 05:58:37.663719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1580/3388] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:37 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:38.044081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:38.045375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:38.051962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.052483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.052923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.053620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.054081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.054541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.057086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:38.181361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:38.190163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31c460cd-fcd0-4e1e-92eb-1084440b6d9a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150005 Sep 11 05:58:38.190733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1809/3389] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:38 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:38.227699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:38.228329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:38.235259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.235732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.236194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.236867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.237317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.237737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.364367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:38.372569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0089f8f8-339b-4ad9-976b-c05d910df2fc tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.148681 Sep 11 05:58:38.373254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1581/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:38 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:38.386306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:38.386915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:38.393851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.394347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.394758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.395475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.395924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.396374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.457154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:38.465184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2414fb2-cc55-4c25-b4b3-82e604be81af tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082720 Sep 11 05:58:38.465738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1810/3391] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:38.686771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:38.687387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:38.693831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.694317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.694762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.695461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:38.695919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:38.696376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:38.825067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:38.834857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49deacc5-0f9a-409e-88ad-fe91b7f5dcc6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152067 Sep 11 05:58:38.835454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1582/3392] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:38 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:39.213449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:39.214067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:39.220658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.221138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.221577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.222264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.222742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.223172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.355106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:39.363571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-609615a0-a6fb-435f-87e8-e4d221748bf9 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153935 Sep 11 05:58:39.364175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1811/3393] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:39 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:39.395638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:39.396294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:39.402121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.402599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.403032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.403962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.404630 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.405062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.488682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:39.489323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:39.495776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.496292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.496729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.498045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.498623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.499049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.535554 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:39.543886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab839bdf-7863-4b00-b261-0237a46b1d82 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152329 Sep 11 05:58:39.545133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1583/3394] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:39 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:39.562002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:39.570257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e899ecf6-b9a8-4a57-8458-8c14412ab61e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085622 Sep 11 05:58:39.570810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1812/3395] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:39.859798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:39.860442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:39.866815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.867298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.867740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:39.868461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:39.868926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:39.869357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.000085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:40.008167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-158c0e21-461b-4596-9f67-1fac220cb402 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153057 Sep 11 05:58:40.008727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1584/3396] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:39 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:40.387510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:40.388864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:40.395758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.396276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.396722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.397420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.397883 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.398310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.526705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:40.535125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e12564a9-a1bb-4695-a67a-4b071744f589 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151559 Sep 11 05:58:40.535751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1813/3397] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:40 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:40.567314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:40.567923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:40.573810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.574288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.574751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.576192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.576904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.577336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.593353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:40.594104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:40.600027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.600535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.600955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.601643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:40.602096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:40.602516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:40.667376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:40.675985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501415c4-9c1e-4b0b-a74b-ccf528f44295 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086667 Sep 11 05:58:40.676581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1814/3398] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:40.711800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:40.720208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c1693847-fe58-47ad-9468-64a60c7200df tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.156685 Sep 11 05:58:40.720767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1585/3399] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:40 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:41.032103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:41.032659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:41.039489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.039981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.040522 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.041217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.041673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.042100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.166712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:41.175524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f232e44-3423-4b78-86a7-45587d96a87b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147411 Sep 11 05:58:41.176105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1815/3400] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:41 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:41.558694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:41.559240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:41.565823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.566303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.566740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.567430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.567970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.568327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.698042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:41.699136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:41.699876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:41.706858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.707009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-977c052f-25f8-4ab8-bed0-942d727384eb tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152339 Sep 11 05:58:41.707481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.707613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1586/3401] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:41 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:41.708064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.708846 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.709377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.709895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.743226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:41.743839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:41.750142 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.750633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.751082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.751786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:41.752285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:41.752721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:41.772300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:41.781136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60df875d-02d4-495b-ac66-eb73b15234d4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086026 Sep 11 05:58:41.781705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1816/3402] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:41.880831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:41.889499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-322139f2-a880-4f63-a3db-6f735e42b832 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150066 Sep 11 05:58:41.890063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1587/3403] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:41 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:42.199070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:42.199589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:42.206273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.206752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.207183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.207867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.208348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.208773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.337143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:42.345641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b950c6cd-c240-42e9-b503-287b24a4de2b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150583 Sep 11 05:58:42.346213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1817/3404] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:42 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:42.730758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:42.731367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:42.738260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.738736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.739171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.739850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.740342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.740765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.803324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:42.803975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:42.810946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.811438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.811879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.812630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.813125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.813553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.876228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:42.877322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:42.885184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d296a948-e678-411a-b644-7bd95f41952b tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.158376 Sep 11 05:58:42.885357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-537d3225-f714-4b9e-91f8-d827a8820492 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086097 Sep 11 05:58:42.885778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1588/3405] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:42 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:42.885911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1818/3406] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:42.913163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:42.913716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:42.920313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.920802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.921245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:42.921937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:42.922428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:42.922858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.050985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:43.059145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb4fb9c6-eaed-4a3d-9aa7-10bce3408cd3 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149801 Sep 11 05:58:43.059706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1819/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:42 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:43.368811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:43.369454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:43.375985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.376496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.376938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.377628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.378086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.378513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.505141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:43.513278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd63f82f-7eff-4875-b1c0-539650290bac tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148294 Sep 11 05:58:43.513846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1589/3408] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:43 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:43.907911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:43.908546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:43.908767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:43.909377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:43.915156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.915645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.915748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.916157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.916249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.916592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.916863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.917274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:43.917362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.917725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:43.917827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.918144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:43.983422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:43.991653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb59f977-37b9-4e71-8d42-3a8fe27f79b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087757 Sep 11 05:58:43.992245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1820/3409] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:44.052014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:44.061139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75ed8864-92aa-4200-ae90-884929039921 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.155830 Sep 11 05:58:44.061640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1590/3410] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:43 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:44.081561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:44.082173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:44.088079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:44.088563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:44.088999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:44.089686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:44.090139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:44.090560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:44.219543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:44.227674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eaa2e9d6-66b9-41e0-9ea7-5f3154fd21c7 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150052 Sep 11 05:58:44.228264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1821/3411] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:44 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:44.536992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:44.537603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:44.543805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:44.544361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:44.544956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:44.545662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:44.546154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:44.546590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:44.675657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:44.683741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41b34230-9d37-411d-9ec1-b19b83caee79 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150581 Sep 11 05:58:44.684338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1591/3412] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:44 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:45.015450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:45.016087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:45.022763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.023244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.023679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.024390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.024844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.025265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.084479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:45.085400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:45.087317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:45.092331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.092837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.093270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.094083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.094566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.094991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.096694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca4cd647-58aa-4827-b4e3-a2a4f2aa3300 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085521 Sep 11 05:58:45.097332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1822/3413] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:45.098946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:45.226029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:45.234865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9029e18-a621-4c2c-8c16-a30a6c3e17a8 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154253 Sep 11 05:58:45.235428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1592/3414] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:45 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:45.251090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:45.251728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:45.253590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:45.258767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.259243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.259677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.260385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.260834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.261254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.390538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:45.399157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab2ead23-65c3-4d78-b208-6e602aa97353 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152126 Sep 11 05:58:45.399832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1823/3415] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:45 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:45.710396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:45.711404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:45.717387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.717860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.718291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.718974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:45.719423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:45.719845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:45.847400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:45.855459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bb8c1a9-ce4b-4e3e-ad9b-a1143ce7879d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151925 Sep 11 05:58:45.856066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1593/3416] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:45 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:46.120412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:46.121022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:46.127564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.128105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.128542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.129219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.129669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.130088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.193114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:46.201741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23034c34-936d-4897-b596-6439285f2dde tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085171 Sep 11 05:58:46.202300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1824/3417] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:46.257941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:46.258559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:46.265441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.265925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.266367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.267066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.267527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.268248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.393628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:46.401720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-818b2074-2e69-46f9-a238-57f669ff34e1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147644 Sep 11 05:58:46.402292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1594/3418] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:46 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:46.422669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:46.423289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:46.429261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.429750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.430191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.430881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.431342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.431771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.559142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:46.561866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:46.568838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd1741ee-c387-4781-9fe4-f370c7e08512 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150116 Sep 11 05:58:46.569602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1825/3419] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:46 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:46.879439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:46.880078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:46.885930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.886428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.886842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:46.887531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:46.888918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:46.889462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.021975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:47.030246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61a0019c-ec87-496d-8ba7-f7a6408faac8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154716 Sep 11 05:58:47.030813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1595/3420] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:46 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:47.224623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:47.225270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:47.232197 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.232689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.233129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.233821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.234278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.234708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.300722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:47.309839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a1282ac-9e82-4aab-b415-d2e160dba389 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088948 Sep 11 05:58:47.310397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1826/3421] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:47.427917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:47.428567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:47.434910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.435401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.435845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.436574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.437032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.437463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.563456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:47.571663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-117f70eb-409b-4100-9666-b7a075e7a430 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147609 Sep 11 05:58:47.572263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1596/3422] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:47 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:47.592236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:47.592995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:47.598949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.599438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.599886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.600614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:47.601071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:47.601503 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:47.731408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:47.740318 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21af7260-a6c3-4f68-bb40-6ca139e3c134 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152430 Sep 11 05:58:47.740884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1827/3423] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:47 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:48.053389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:48.053996 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:48.059918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.060930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.061699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.062412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.062868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.063293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.193566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:48.202365 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3392d88a-1055-4fac-a0c9-bda64b437fb5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152862 Sep 11 05:58:48.202924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1597/3424] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:48 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:48.332982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:48.333600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:48.339943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.340463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.340903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.341654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.342113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.342543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.403823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:48.412138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13aa028c-97d5-4ba2-93b2-41ec52ae4885 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083039 Sep 11 05:58:48.412701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1828/3425] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:48.596138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:48.596682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:48.602955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.603431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.603866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.604578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.605030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.605453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.731875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:48.740959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a559d688-c1ba-4230-aedf-4df8b1547e13 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149344 Sep 11 05:58:48.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1598/3426] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:48 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:48.765821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:48.766435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:48.772575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.773053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.773487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.774164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:48.774613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:48.775035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:48.905645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:48.913864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3a90e3f-d22e-4677-8ed1-382fdc92d327 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.152384 Sep 11 05:58:48.914424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1829/3427] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:48 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:49.225657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:49.226195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:49.232316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.232937 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.233370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.234056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.234506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.234925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.362026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:49.370170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25f98750-85e7-4fe1-9d4a-fda4af90a955 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148473 Sep 11 05:58:49.370821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1599/3428] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:49 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:49.434911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:49.436102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:49.442471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.442955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.443402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.444118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.444579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.445010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.506675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:49.514972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e6afb9c-81ad-4ee9-b89c-fd2d2c5500d7 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083914 Sep 11 05:58:49.515526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1830/3429] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:49.765587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:49.766102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:49.772530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.773013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.773454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.774147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.774601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.775026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.906930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:49.915076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad03fe2c-a8c9-4614-882d-cf91f8629e0a tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153619 Sep 11 05:58:49.915647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1600/3430] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:49 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:49.937496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:49.938103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:49.943942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.944474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.944908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:49.945592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:49.946044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:49.946465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.071685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:50.080608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94a0ff09-a6a3-479f-9e7c-abba572055a4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147238 Sep 11 05:58:50.081178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1831/3431] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:49 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:50.395625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:50.396276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:50.402232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.402721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.403164 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.403861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.404502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.404934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.536121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:50.537337 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:50.538112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:50.544396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.544578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d088c88-09d8-4b8e-b85b-5a613066f636 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153059 Sep 11 05:58:50.544978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.545143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1601/3432] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:50 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:50.545557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.546328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.546796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.547231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.613737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:50.621855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66afc25a-27ad-41b0-87f9-99e03b59bd41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088360 Sep 11 05:58:50.622444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1832/3433] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:50.939160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:50.939773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:50.942088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=98 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:50.947213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.947701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.948180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:50.948881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:50.949343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:50.949775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.080963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:51.089051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fef80443-6f8a-4228-ac04-08ffaadeb5b5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.154637 Sep 11 05:58:51.089626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1602/3434] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:50 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:51.103973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:51.104604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:51.111138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.111619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.112081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.112767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.113218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.113639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.239210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:51.247264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d88e42a5-bdb3-4555-b62d-6d7916ea2851 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.147106 Sep 11 05:58:51.247834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1833/3435] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:51 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:51.567544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:51.568186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:51.574246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.574735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.575172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.576417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.577175 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.577602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.646004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:51.646702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:51.653146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.653640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.654724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.655638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:51.656136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:51.656610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:51.706734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:51.714885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbac68eb-d335-4493-975e-d1fbb54235a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.151242 Sep 11 05:58:51.715453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1603/3436] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:51 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:51.721728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:51.731340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19709685-59d7-49e4-b836-f80ab86cc05d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089416 Sep 11 05:58:51.731902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1834/3437] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:52.112451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:52.113059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:52.119481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.119957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.120435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.121118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.121570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.121987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.253788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:52.261864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4674b220-16a9-4a5c-9de6-88c9c774ea8c tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.153375 Sep 11 05:58:52.262452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1604/3438] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:52 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:52.270187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:52.270806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:52.276691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.277174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.277612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.278297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.278749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.279215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.408069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:52.416323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7c0e020-ed35-4e1d-b451-9a5dc250f413 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150207 Sep 11 05:58:52.416888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1835/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:52 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:52.739687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:52.740267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:52.746135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.746616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.747056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.747818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.748343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.748773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.754160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:52.754770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:52.761033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.761515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.761949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.762634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:52.763086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:52.763581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:52.826412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:52.835135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-addc7cec-889d-4e7e-b6e4-535ea3f7d90b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084710 Sep 11 05:58:52.843143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1836/3440] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:52.881807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:52.890690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7f11db6c-d962-4348-b0ac-111f2933f19a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.154974 Sep 11 05:58:52.891249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1605/3441] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:52 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:53.285445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:53.286051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:53.291976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.292489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.292921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.293599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.294049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.294469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.419354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:53.427646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e785f377-49ea-4143-8bc0-2615955d83df tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.146032 Sep 11 05:58:53.428238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1837/3442] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:53 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:53.440351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:53.440973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:53.447326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.447813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.448292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.448990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.449450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.449877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.578193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:53.586305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b78a6ad0-41a5-4ef3-8fee-a9d002d2f335 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.150206 Sep 11 05:58:53.586878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1606/3443] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:53 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:53.858980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:53.859518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:53.865905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.866389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.866828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.867521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.867975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.868423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.914744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:53.915349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:53.921995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.922476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.922910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.923603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:53.924087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:53.924510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:53.934115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:53.942978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc755000-dcc8-407c-8cdb-854da62ed5b1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088423 Sep 11 05:58:53.943864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1838/3444] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:54.055967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:54.064383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af33a484-1555-418a-b5c0-856dba55f4ef tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.153484 Sep 11 05:58:54.064951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1607/3445] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:53 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:54.451516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:54.452160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:54.458176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.458668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.459113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:54.459809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.460297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.460731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:54.587199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:54.596047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c89479ce-f5b4-40bd-a4bc-bc2ca9a092e5 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149223 Sep 11 05:58:54.596604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1839/3446] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:54 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:54.609639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:54.610252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:54.616700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.617186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.617625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:54.618318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.618781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.619215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:54.747312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:54.749579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:54.756945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db2618fc-c541-4952-a8c4-e71723ce0baf tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.151417 Sep 11 05:58:54.757526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1608/3447] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:54 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:54.966125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:54.966748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:54.973140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.973636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.974081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:54.974773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:54.975231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:54.975664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.037114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:55.045421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3128e65-9ea4-459d-84a0-58fa1246fff0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084159 Sep 11 05:58:55.045980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1840/3448] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:55.087839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:55.088471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:55.094424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.094910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.095352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.096067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.096528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.096960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.227157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:55.236050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97ba0e33-2217-424b-8efa-68f68655eb7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152265 Sep 11 05:58:55.236639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1609/3449] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:55 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:55.618842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:55.619483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:55.626013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.626497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.626937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.627622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.628103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.628532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.756847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:55.766198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d80a7679-38d5-424f-9c53-0252d8e9e718 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151263 Sep 11 05:58:55.766766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1841/3450] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:55 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:55.781179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:55.781890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:55.788232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.788713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.789149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.789834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:55.790285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:55.790707 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:55.917181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:55.926123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d8a1713-7d9b-43a7-a566-1527f6e25dd2 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.149081 Sep 11 05:58:55.926687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1610/3451] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:55 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:56.068833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:56.069471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:56.075917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.076426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.076861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.077543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.077993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.078418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.092871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:58:56.141975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:56.150777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39677fe7-764e-43eb-b337-a39c36fbbc45 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085984 Sep 11 05:58:56.151453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1842/3452] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:56.259290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:56.259821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:56.266014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.266491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.266929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.267634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.268378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.268804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.393125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:56.401136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-90327de7-f086-4da9-b6c4-14ec3fd6fe94 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.145909 Sep 11 05:58:56.401700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1611/3453] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:56 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:56.790252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:56.790861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:56.796939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.797417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.797845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.798563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.799016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.799433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.925630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:56.933799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c782428e-e0f3-43ce-af30-9390b364ad0e tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147691 Sep 11 05:58:56.934362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1843/3454] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:56 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:56.949436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:56.950043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:56.957113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.957595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.958030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:56.958716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:56.959166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:56.959588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.092252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:57.100339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69c8d915-3375-4bc9-b1f2-cf6538eded93 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.154643 Sep 11 05:58:57.100910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1612/3455] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:56 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:57.174325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:57.174936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:57.181257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.181773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.182210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.182896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.183353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.183780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.248380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:57.256622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f75df65-0b41-4c01-b8e6-ff7e4c990530 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086268 Sep 11 05:58:57.257183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1844/3456] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:57.425079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:57.425729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:57.431593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.432219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.432656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.433337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.433784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.434200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.561924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:57.570016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1061789b-46e9-410f-a27c-431bf4a345e7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.148754 Sep 11 05:58:57.570573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1613/3457] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:57 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:57.957623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:57.958231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:57.964242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.964722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.965156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:57.965836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:57.966287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:57.966716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.095842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:58.103921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-264f285e-4e82-45ca-8a74-a0cbacb8ebe1 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150138 Sep 11 05:58:58.104508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1845/3458] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:57 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:58.123085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:58.123720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:58.130334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.130809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.131244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.131925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.132415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.132839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.263475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:58.271880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b5bb203-c574-4bc7-9426-d2ed0bb469b8 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153183 Sep 11 05:58:58.272485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1614/3459] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:58 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:58.280567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:58.281193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:58.287531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.288050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.288496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.289200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.289659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.290091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.351817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:58.360623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd2641fe-9bb5-4fca-a594-0db759998577 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084560 Sep 11 05:58:58.361193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1846/3460] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:58.594600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:58.595210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:58.601160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.601640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.602079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.602783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:58.603218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:58.603640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:58.729957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:58.738192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1cb6595e-d536-460b-9073-155103b41e5e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147587 Sep 11 05:58:58.738756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1615/3461] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:58 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:59.127757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:59.128401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:59.134301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.134780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.135214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.135900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.136384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.136820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.265487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:59.273943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d63674a0-67c2-4e39-af1e-04393088ebaa tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150157 Sep 11 05:58:59.274514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1847/3462] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:59 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:59.296123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:59.296748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:59.303216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.303703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.304189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.304889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.305354 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.305783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.382675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:59.383280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:59.389314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.389824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.390235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.390924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.391379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.391800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.436942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:59.445130 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49e694f5-2147-40c6-9201-fa1736793cd4 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153689 Sep 11 05:58:59.445709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1616/3463] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:59 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:58:59.454329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:59.462544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f77a10b9-fafc-48d3-bb04-0aa3c52dd2cb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083753 Sep 11 05:58:59.463099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1848/3464] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:58:59.761748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:58:59.762278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:58:59.769299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.769912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.771972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.772736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:58:59.773197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:58:59.774140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:58:59.913431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:58:59.921902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29010835-b57b-4449-866e-a69fff379162 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.164112 Sep 11 05:58:59.922463 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1617/3465] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:58:59 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:00.298261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:00.298876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:00.305269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.305791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.306235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.306927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.307389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.307810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.436261 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:00.444598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e154550-4512-4487-998b-a3d67153940d tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.150234 Sep 11 05:59:00.445161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1849/3466] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:00 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:00.470385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:00.471029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:00.476825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.477311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.477753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.478447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.478912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.479371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.486219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:00.486837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:00.492658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.493156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.493612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.494310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.494763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.495192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.561746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:00.570275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00c3184c-4385-4f10-bf5c-0eb90d441964 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088447 Sep 11 05:59:00.571180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1850/3467] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:00.628640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:00.636975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a00190d0-5198-42ef-97f2-d358c0e2898f tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.172238 Sep 11 05:59:00.637770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1618/3468] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:00 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:00.944966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:00.945582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:00.951825 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.952344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.952781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:00.953471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:00.953928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:00.954354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.080900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:01.089029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b4929a7-05e0-41da-aa18-d1a19054f3f1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147951 Sep 11 05:59:01.089594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1851/3469] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:00 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:01.468863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:01.469471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:01.475760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.476318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.476690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.477375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.477823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.478243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.593486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:01.594396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:01.600762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.601244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.601674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.602359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.602809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.603227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.608387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:01.616676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18b318e6-a02e-4f67-a8fa-34fa723610c6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.152284 Sep 11 05:59:01.617265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1619/3470] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:01 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:01.660708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:01.661334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:01.667697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.668254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.668684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.669464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:01.670189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:01.670677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:01.810725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:01.818840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ebb040b5-d984-4085-b710-9618d3ffc305 tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.162151 Sep 11 05:59:01.819406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1620/3471] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:01 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:01.823053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:01.831291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff5a305e-e74f-4f67-8a94-a51011dccd3b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.241996 Sep 11 05:59:01.832054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1852/3472] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:02.111978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:02.112614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:02.118416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.118894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.119329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.120044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.120505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.120925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.250774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:02.258909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb3766d0-3fa0-49c6-8034-699f6c73009b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150826 Sep 11 05:59:02.259477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1621/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:02 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:02.641504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:02.642127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:02.648751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.649241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.649682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.650380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.650842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.651272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.779512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:02.787722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7c4a46d-1c9a-42e0-9ea3-a1f863631420 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.151063 Sep 11 05:59:02.788495 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1853/3474] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:02 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:02.842303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:02.847816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:02.854532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:02.854697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.855141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:02.855246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.855608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.856338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.857331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.857762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.862002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.862486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.862927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.863619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:02.864173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:02.864603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:02.925982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:02.934139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de9db9d6-b762-4350-a68f-ad5f603751a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083385 Sep 11 05:59:02.934696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1854/3475] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:02.988214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:02.996350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c242faf5-7607-4482-935f-37300729e8ed tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.157944 Sep 11 05:59:02.996915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1622/3476] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:02 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:03.282874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:03.283415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:03.289299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.289773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.290212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:03.290899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.291358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.292049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:03.417317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:03.426090 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e6398db-0249-48ad-901f-2ec9e6519c7c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.147277 Sep 11 05:59:03.426652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1855/3477] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:03 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:03.810801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:03.811412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:03.817322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.817800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.818235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:03.818924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.819375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.819796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:03.945950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:03.954129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8153d90c-c71e-4275-ab4c-a6a3bc043142 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.147256 Sep 11 05:59:03.954693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1623/3478] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:03 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:03.957240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:03.957852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:03.964479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.965039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.965558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:03.967037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:03.967830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:03.968367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.019153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:04.019762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] [instance: 811bc271-657e-410b-9fb8-dfc4c0ca1880] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:04.025565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.026050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.026483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.027173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.027624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.028072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.032711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:04.040895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fc86b34-c652-4796-a21d-92bab69c9731 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087436 Sep 11 05:59:04.041549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1856/3479] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:04.160027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9793a6256764417eb3ff1a8386368801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbab28318bf84c88b2f3a774defb870f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:04.168173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3fb10f41-4bbf-4656-9a4c-c12737e119ef tempest-VolumesSnapshotTestJSON-1807413832 tempest-VolumesSnapshotTestJSON-1807413832-project] 10.222.0.33 "GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880" status: 200 len: 1559 microversion: 2.1 time: 0.153127 Sep 11 05:59:04.168746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1624/3480] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:04 2022] GET /compute/v2.1/servers/811bc271-657e-410b-9fb8-dfc4c0ca1880 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:04.449941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:04.451001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:04.457170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.457659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.458098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.458795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.459257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.459687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.587918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:04.596342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0f27722-6fd7-4600-a3e4-f7c1b602d489 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.150320 Sep 11 05:59:04.596904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1857/3481] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:04 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:04.977860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:04.978422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:04.984952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.985443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.985884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:04.986587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:04.987047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:04.987540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:05.002772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:05.064820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:05.065960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:05.072680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:05.073176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:05.073594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:05.074291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:05.074745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:05.075164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:05.140978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:05.149476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9392d714-a275-4574-ae29-d3e9719248f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088854 Sep 11 05:59:05.150045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1858/3482] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:05.179830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:05.188249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b377bde5-fc6c-4be8-b8b1-ba528e1f6477 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.214355 Sep 11 05:59:05.188909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1625/3483] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:04 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:05.618717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:05.619323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:05.625673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:05.626151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:05.626587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:05.627271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:05.627720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:05.628170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:05.631976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:05.758766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:05.767788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b9f58e2-5cd6-4401-9fae-297dc1e35900 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.152960 Sep 11 05:59:05.768637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1859/3484] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:05 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:06.172676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:06.173318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:06.179682 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.180205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.180647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.181350 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.181800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.182230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.212276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:06.212890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] [instance: e812967c-7475-468f-a1c8-433fef2f929c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:06.219356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.219836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.220309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.221004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.221453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.221873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.244659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:06.253620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-261bc188-23ec-4d56-8eb3-7e88270b1836 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084809 Sep 11 05:59:06.254193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1626/3485] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:06.349451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9acda7a0d8c4834aace017083393cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4ccd5b2fa14cd188de7c86f31d8632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:06.357706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b23f311d-f703-43da-a8a9-d4d0292b6be6 tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c" status: 200 len: 1598 microversion: 2.1 time: 0.149278 Sep 11 05:59:06.358267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1860/3486] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:06 2022] GET /compute/v2.1/servers/e812967c-7475-468f-a1c8-433fef2f929c => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:06.380336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c11b72cf-6c02-449e-a474-228525f84fef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] Calling method '.version_select at 0x7f2c3f148a60>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:06.399313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c11b72cf-6c02-449e-a474-228525f84fef tempest-TestMinimumBasicScenario-1546674314 tempest-TestMinimumBasicScenario-1546674314-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-536814004" status: 202 len: 0 microversion: 2.1 time: 0.022679 Sep 11 05:59:06.399801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1627/3487] 10.222.0.33 () {58 vars in 1269 bytes} [Sun Sep 11 05:59:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-536814004 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:59:06.791111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:06.791877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:06.798042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.798532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.798971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.799815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:06.800244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:06.800606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:06.952604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:06.960904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc8fdde7-4980-404c-918c-f4e5f0113600 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.173549 Sep 11 05:59:06.961484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1861/3488] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:06 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:07.143771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:07.144314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:07.150490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.151152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.151766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.152500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.153125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.154179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.182341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 05:59:07.275082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7be6bf9e-02b9-4a1f-a835-c70949e089d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 204 len: 0 microversion: 2.1 time: 0.134941 Sep 11 05:59:07.276197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1628/3489] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 05:59:07 2022] DELETE /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 05:59:07.283890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:07.285190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:07.291620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:07.299831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:07.306322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.307178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.307825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.308973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.309698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.311023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.318757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.319597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.321851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.323361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.324024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.326938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.428901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:07.438693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1b48cf1-5111-4544-a881-7331716d8eee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.164444 Sep 11 05:59:07.440112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1862/3490] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:07.498869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:07.507067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccf75fe6-92a8-458a-81af-a46d14fe5842 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.221613 Sep 11 05:59:07.507634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1629/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:07.986191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:07.986821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:07.993179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.993671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.994102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:07.994806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:07.995258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:07.995681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:08.280699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:08.289033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcebc88c-9893-4016-961e-584aa1efbcff tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 200 len: 1727 microversion: 2.1 time: 0.307790 Sep 11 05:59:08.289596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1863/3492] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:07 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 1727 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:08.312750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3f909f8-3e85-467e-9115-b9d9d70efc6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '.version_select at 0x7f2c3f00a310>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:08.333410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3f909f8-3e85-467e-9115-b9d9d70efc6c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919299396" status: 202 len: 0 microversion: 2.1 time: 0.025114 Sep 11 05:59:08.334123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1630/3493] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 11 05:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919299396 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 05:59:08.463229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:08.463940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:08.470919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:08.471507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:08.472049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:08.472820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:08.473354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:08.473856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:08.532152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:08.533507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:08.539012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:08.539696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:08.540335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:08.541207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:08.541817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:08.542434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:08.548987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:08.560331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47518f85-26f6-471a-926c-3ad648fa08d2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.100726 Sep 11 05:59:08.577791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1864/3494] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:08.767473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:08.779710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-517b507a-c38d-488b-b82e-ed4f441ff63b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.251599 Sep 11 05:59:08.780965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1631/3495] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:09.583708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:09.584348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:09.595152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:09.595657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:09.596150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:09.596871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:09.597330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:09.597801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:09.649375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42e41e9-5297-4be5-a77d-6558fdb3b01f", "tag": "de1a56c3-9f13-4434-afbc-573439a20fe3"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:09.662204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:09.672690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:09.673360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:09.686928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] Creating event network-changed:de1a56c3-9f13-4434-afbc-573439a20fe3 for instance c42e41e9-5297-4be5-a77d-6558fdb3b01f on hv-cinder-85692 Sep 11 05:59:09.695985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-31079916-54f6-4e57-bb14-043522ad042e req-7a667e9d-bb9e-4de5-bb5c-b382f025c44c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050632 Sep 11 05:59:09.703202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1632/3496] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:59:09.762183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:09.813659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:09.815255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:09.818676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e55806ef-3a40-4db7-ba52-14d821358366 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.238677 Sep 11 05:59:09.821865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1865/3497] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:09.825189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:09.826491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:09.827020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:09.844080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:09.846808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:09.849241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:09.936434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: .version_select at 0x7f2c42828790>, body: {"keypair": {"name": "tempest-keypair-2137103143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXzEVIxOq+VFOum4eBvSD7sA1RXi+iVqHB/8JbBgubb4VBzuzrMBI1dQFFpnhT/veUunCIMtd41sZmR1JHK5qaPDSka87qJpiX3coDWU8Iz0EEh4Sq2C6vyvJn8+4Oykg=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:09.963432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:59:09.968995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:59:09.982541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [0e0be7d3-f8ba-479c-81e9-0eebbd98375a] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 05:59:10.169716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:10.178200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e1b14a9-ce9f-4e2f-86e2-0ae6c5158cf2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.375552 Sep 11 05:59:10.179521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1633/3498] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:10.848501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:10.850082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:10.858756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:10.861789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:10.862514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:10.863316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:10.863777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:10.864247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:10.934464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:10.943884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d8f2f9f-2be1-4820-baae-675993f177b0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.099334 Sep 11 05:59:10.944878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1634/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:10.990336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [0e0be7d3-f8ba-479c-81e9-0eebbd98375a] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 35144. Sep 11 05:59:11.005874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c9c5029-0343-4cd9-80f9-b3ad4f9aec42 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.084596 Sep 11 05:59:11.006478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1866/3500] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 05:59:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:59:11.201943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:11.202560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:11.208668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:11.209233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:11.209883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:11.210594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:11.211057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:11.211491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:11.379314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:11.387661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-736cb6d1-2dae-49de-a9c3-3662d71518ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.189744 Sep 11 05:59:11.388606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1635/3501] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:11.967427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:11.968237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:11.975177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:11.975786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:11.976327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:11.977107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:11.977664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:11.978166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:12.058939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:12.068088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-234aebc6-1539-4729-923f-c530965e6fc4 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.105284 Sep 11 05:59:12.068671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1867/3502] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:12.321050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427554595", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42ad47aa-0576-4a66-864b-0cf4e79a54c6"}], "security_groups": [{"name": "tempest-securitygroup--1159804356"}], "key_name": "tempest-keypair-2137103143", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:12.412511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:12.413125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:12.414960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:12.420655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:12.421174 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:12.421612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:12.422311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:12.422766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:12.423193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:12.426749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] validate_networks() for [('42ad47aa-0576-4a66-864b-0cf4e79a54c6', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 05:59:12.559175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:12.567788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb541767-fab1-436f-a399-b774164531e2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159413 Sep 11 05:59:12.568405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1868/3503] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:12.860462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 05:59:12.860882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 05:59:12.861356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 05:59:12.861760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 05:59:12.862166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 05:59:12.870759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:12.871235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:12.871664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:12.872506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:12.872960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:12.873382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:12.889546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 05:59:12.893666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 05:59:12.904835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 05:59:12.907080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 05:59:12.954739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7fa3086-a39d-4b0d-bbfe-2e78cd82ac05 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637914 Sep 11 05:59:12.955386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1636/3504] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 05:59:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 05:59:12.967417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20d252fa-3d49-4d6c-8b9e-c7cbbf96243a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:12.968066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20d252fa-3d49-4d6c-8b9e-c7cbbf96243a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:13.024656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20d252fa-3d49-4d6c-8b9e-c7cbbf96243a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:13.032026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20d252fa-3d49-4d6c-8b9e-c7cbbf96243a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1242 microversion: 2.1 time: 0.069205 Sep 11 05:59:13.032586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1869/3505] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:12 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:13.094491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:13.095111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:13.101206 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:13.101699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:13.102145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:13.102845 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:13.103306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:13.103738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:13.171397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:13.179435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37b31744-16cc-48c4-9258-815476829d9c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089497 Sep 11 05:59:13.180032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1637/3506] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:13.591271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:13.592122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:13.598042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:13.598530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:13.598978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:13.599678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:13.600141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:13.600592 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:13.733998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:13.742386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-938dbc34-7d07-404a-9a31-1547b8f9a76c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155197 Sep 11 05:59:13.742948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1870/3507] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:14.054560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:14.055180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:14.062338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.062825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.063266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.063961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.064451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.064883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.126029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:14.133597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3b1801f-14b5-4126-a23f-04ed69934db6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1294 microversion: 2.1 time: 0.082900 Sep 11 05:59:14.134163 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1638/3508] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:14 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:14.204992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:14.205597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:14.211946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.212457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.212893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.213586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.214038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.214460 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.279468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:14.287816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96fa45d5-fe10-468b-8a82-fc27a3ae0eef tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086807 Sep 11 05:59:14.288411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1871/3509] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:14 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:14.767059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:14.767674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:14.769954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:14.775126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.775618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.776088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.776792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:14.777257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:14.777693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:14.973559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:14.982271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1db70d42-339a-4de7-8342-e7a1c9eb7bbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.218488 Sep 11 05:59:14.982848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1639/3510] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:15.157593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:15.158230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:15.166748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:15.166748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:15.168067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:15.168067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:15.170029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:15.172015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:15.311608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:15.312318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:15.321205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:15.322794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:15.323364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:15.324156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:15.325652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:15.326196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:15.326697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:15.330184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2744f3eb-66cf-4f6a-bb47-e81a6573d4f0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.177091 Sep 11 05:59:15.331113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1872/3511] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:15 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:15.405309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:15.413675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5fd9493-fa61-4373-b8be-2c6d9673ea37 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.106788 Sep 11 05:59:15.414248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1640/3512] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:15.938951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076459f2-fb04-482c-a87a-fb95f2bc085e", "tag": "f74433ac-8a09-40d2-96de-91cba19d8482"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:15.949465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:15.950976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:15.951545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:15.963139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] Creating event network-changed:f74433ac-8a09-40d2-96de-91cba19d8482 for instance 076459f2-fb04-482c-a87a-fb95f2bc085e on hv-cinder-85692 Sep 11 05:59:15.969394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f8013f78-fb08-4368-af7c-9ba47be15a35 req-c6432612-9384-4259-9798-dec61b7ff5cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035929 Sep 11 05:59:15.969996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1873/3513] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:59:16.006318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:16.006935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:16.013056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.013467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.014022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.014734 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.015195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.015627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.222442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:16.230733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79a0a077-6282-4a7c-ad9b-0f0f436ef1bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.228271 Sep 11 05:59:16.231308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1641/3514] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:16.357036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:16.357757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:16.364312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.364798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.365233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.365920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.366598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.366800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.438625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:16.439358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:16.445832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.446522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.446964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.447840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:16.448340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:16.448771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:16.501177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:16.508992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9184d9d8-fd0d-48ac-b7fd-6cdd36458810 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.157234 Sep 11 05:59:16.509778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1874/3515] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:16 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:16.521371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:16.530476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d65bf028-1312-4781-beb8-46c290eef2db tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.095953 Sep 11 05:59:16.531047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1642/3516] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:17.254531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:17.255167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:17.261171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.261652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.262088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.262924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.263706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.264186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.394165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:17.402314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76122551-2573-428a-a045-77a415f36614 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151607 Sep 11 05:59:17.402861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1875/3517] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:17.532886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:17.533404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:17.539779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.540292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.540724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.541404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.541852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.542272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.553233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:17.553881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:17.559773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.560297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.560742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.561467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:17.561931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:17.562365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:17.626003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:17.634266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e08c8eda-1225-4483-aa7b-c7ab32ea45c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084906 Sep 11 05:59:17.634844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1876/3518] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:17.671931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:17.674157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:17.680804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08a7d776-94da-4b7e-9e03-04ad78abe0c5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.152605 Sep 11 05:59:17.681372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1643/3519] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:17 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:18.426056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:18.426716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:18.433158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.433638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.434072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.435417 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.435870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.436320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.564736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:18.572959 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bb88184-3aec-4ef4-8e69-e9ca072e0639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150803 Sep 11 05:59:18.573529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1877/3520] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:18.656776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:18.657923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:18.665493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.665990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.666436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.667134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.667598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.668056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.703506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:18.704063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:18.710093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.710582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.711022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.711725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:18.712213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:18.712641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:18.727615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:18.730189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:18.739221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b19f6ac-2a99-4945-a556-852d537a8a3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086523 Sep 11 05:59:18.739804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1644/3521] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:18.845665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:18.854490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e732c2b4-70dc-4939-88cb-e4804482217e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.154855 Sep 11 05:59:18.855588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1878/3522] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:18 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:19.596261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:19.596875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:19.602767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.603278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.603742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:19.604458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.604982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.605430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:19.738568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:19.748121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d68cd3ed-9254-4a02-bdf1-8753d4df9f10 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155708 Sep 11 05:59:19.748709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1645/3523] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:19.763243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:19.763859 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:19.770614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.771104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.771553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:19.772787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.773447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.773882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:19.845410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:19.858991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59e55500-948d-41e8-b498-f9867ee3cc67 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.100001 Sep 11 05:59:19.859608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1879/3524] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:19.878687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:19.879298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:19.887218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.888395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.888832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:19.889539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:19.889997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:19.890422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:20.053846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:20.072632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5694193c-8b1e-48d7-a4f0-b3c94ac1b0d9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.197670 Sep 11 05:59:20.073268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1646/3525] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:19 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:20.773925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:20.774549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:20.782280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:20.782771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:20.783212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:20.783917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:20.784399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:20.784829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:20.888938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:20.889561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:20.896303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:20.896796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:20.897241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:20.897953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:20.898439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:20.898897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:20.918010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:20.926756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dc3f5de-dae3-454a-b59b-6e84a2b7ef38 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156771 Sep 11 05:59:20.927638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1880/3526] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:20.961170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:20.970079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3f013c8-c5c7-4193-ab83-bca34a670fc8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085474 Sep 11 05:59:20.970647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1647/3527] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:21.097459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:21.098079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:21.103989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:21.104515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:21.104950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:21.105640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:21.106091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:21.106564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:21.235444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:21.243114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e68d70a-317c-44a8-89a8-1c28cd1f8944 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.149498 Sep 11 05:59:21.243682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1881/3528] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:21 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:21.950582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:21.951195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:21.958318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:21.958805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:21.959238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:21.959932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:21.960406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:21.960824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:21.992765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:21.993891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:22.000839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:22.001420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:22.003377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:22.003377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:22.003377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:22.003843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:22.072077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:22.081392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e99cb471-4058-43bd-b723-edb35193f954 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.092329 Sep 11 05:59:22.097262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1882/3529] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:22.114061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:22.122319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eba02b44-0120-4ebf-ae79-edbe48a0858e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.175793 Sep 11 05:59:22.122910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1648/3530] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:22.134125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076459f2-fb04-482c-a87a-fb95f2bc085e", "name": "network-vif-plugged", "status": "completed", "tag": "f74433ac-8a09-40d2-96de-91cba19d8482"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:22.144582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:22.145099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:22.145572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:22.158875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] Creating event network-vif-plugged:f74433ac-8a09-40d2-96de-91cba19d8482 for instance 076459f2-fb04-482c-a87a-fb95f2bc085e on hv-cinder-85692 Sep 11 05:59:22.164375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-9ba3c76d-84ed-439c-8d41-1bbf4d53b904 req-db3485ab-1fff-4a8c-b928-9a6904945b8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Sep 11 05:59:22.164958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1883/3531] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 05:59:22.266472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:22.267098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:22.275187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:22.275679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:22.276152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:22.276852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:22.277309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:22.277732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:22.468888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:22.476716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d2ba3d2a-b079-4005-b9ea-793c136fae5c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.215236 Sep 11 05:59:22.477283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1649/3532] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:22 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:23.105467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:23.106680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:23.109357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:23.114792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.115273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.115709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.116418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.116872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.117293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.146448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:23.147061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:23.148953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:23.149805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:23.156859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.157348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.157790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.158488 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.158948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.159378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.180942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:23.189695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f683f547-3615-4fe0-807f-b62b9462fa13 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088413 Sep 11 05:59:23.190270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1884/3533] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:23.288114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:23.296775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a9ccb27-fc98-4e25-a0d8-176d9923e4a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154376 Sep 11 05:59:23.297347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1650/3534] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:23.500164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:23.500707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:23.506648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.507134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.507572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.508283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:23.508739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:23.509167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:23.639670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:23.647491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f35ebfd-f304-46e0-ad43-bee28b769dea tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1368 microversion: 2.1 time: 0.151918 Sep 11 05:59:23.648069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1885/3535] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:23 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:24.211345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:24.211949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:24.219265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.219751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.220228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.220927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.221384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.221813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.282880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:24.291189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8803089-b215-4c45-b095-101396e64a9f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083686 Sep 11 05:59:24.291761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1651/3536] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:24.320443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:24.321064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:24.327574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.328096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.328544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.329270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.329735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.330175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.463257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:24.472418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e49ae786-0287-4be6-86c8-15c59669930b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155816 Sep 11 05:59:24.472983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1886/3537] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:24.670415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:24.671022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:24.677259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.677751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.678194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.678901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.679360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.679788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.810144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:24.817714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c35e84ae-e85f-46cd-a1b1-57f943b0122c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1557 microversion: 2.1 time: 0.151293 Sep 11 05:59:24.818289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1652/3538] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:24 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:24.840145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:24.840798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:24.846907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.847389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.847823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.848536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:24.848992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:24.849413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:24.925639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a58c611-10bc-481a-80ea-805e6a7aa7cd tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089292 Sep 11 05:59:24.926246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1887/3539] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 05:59:24 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:59:25.314247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:25.314857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:25.321327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:25.321818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:25.322261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:25.322964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:25.323424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:25.323850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:25.391150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:25.399729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18494cc4-e4ab-4d07-92ea-22bccbc57a62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089452 Sep 11 05:59:25.400344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1653/3540] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:25 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:25.497276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:25.498020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:25.504317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:25.504804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:25.505240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:25.505958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:25.506406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:25.506837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:25.721581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:25.730783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b544e00b-b6e4-4778-81a0-63b0899863e5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.237915 Sep 11 05:59:25.731751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1888/3541] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:26.175790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076459f2-fb04-482c-a87a-fb95f2bc085e", "tag": "f74433ac-8a09-40d2-96de-91cba19d8482"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 05:59:26.185817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:26.186291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:26.186721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:26.197287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] Creating event network-changed:f74433ac-8a09-40d2-96de-91cba19d8482 for instance 076459f2-fb04-482c-a87a-fb95f2bc085e on hv-cinder-85692 Sep 11 05:59:26.202613 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-210d2afa-b25f-45c9-9a89-fed0e6978e62 req-4d82b1c0-4a69-40c3-bd13-96870a8ef236 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030406 Sep 11 05:59:26.203478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1654/3542] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 05:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 05:59:26.423358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:26.425017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:26.430233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:26.430739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:26.431169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:26.432243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:26.432352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:26.432765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:26.497627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:26.506721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dee3d1d8-9491-40d8-a1d0-d610bcfcb520 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087852 Sep 11 05:59:26.507635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1889/3543] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:26.758838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:26.759551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:26.766462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:26.766976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:26.767427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:26.768450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:26.768919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:26.769356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:26.904814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:26.913104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec38a11e-134b-4cf2-b45e-3e9b154027ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159064 Sep 11 05:59:26.913670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1655/3544] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:27.530554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:27.531106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:27.537741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:27.538230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:27.538674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:27.539402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:27.539868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:27.540336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:27.603390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:27.611645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77880409-d570-448c-a409-570c4cd1ee7a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085843 Sep 11 05:59:27.612245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1890/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:27.938034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:27.938642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:27.945001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:27.945486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:27.945928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:27.946615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:27.947073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:27.947501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:28.078070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:28.086109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b9e119c-f641-4044-a42d-2d5a9ddc2f6b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152567 Sep 11 05:59:28.086667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1656/3546] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:28.634505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:28.635118 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:28.642247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:28.642725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:28.643422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:28.644137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:28.644593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:28.645017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:28.705465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:28.713604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e49756e0-194e-48fa-977e-eb35ad9ac53c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082944 Sep 11 05:59:28.714159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1891/3547] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:29.109968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:29.110575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:29.116883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:29.117362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:29.117796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:29.118474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:29.118921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:29.119338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:29.246010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:29.254737 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02ce8ab5-a473-4a66-88c3-86c3fcd12292 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149103 Sep 11 05:59:29.255309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1657/3548] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:29.737034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:29.737654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:29.744086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:29.744573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:29.745011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:29.745700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:29.746154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:29.746586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:29.811668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:29.819907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-423f55be-6e14-4276-a1b2-2c816613749b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086784 Sep 11 05:59:29.820492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1892/3549] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:30.279543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:30.280211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:30.286341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:30.286824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:30.287259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:30.287943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:30.288424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:30.288871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:30.419298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:30.427651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9d3a470-6c02-4fbd-814e-6eb6488bd2c7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152727 Sep 11 05:59:30.428248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1658/3550] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:30.842876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:30.843491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:30.849978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:30.850468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:30.850910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:30.851658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:30.852149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:30.852863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:30.914457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:30.923129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10694fa4-a7e7-43d5-af6a-f7931402b6ce tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084328 Sep 11 05:59:30.923694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1893/3551] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:31.451309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:31.451919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:31.458242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:31.458723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:31.459157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:31.459837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:31.460322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:31.460740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:31.586468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:31.595291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d4fb921e-17eb-4ba6-875d-a3e339e22f7c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148166 Sep 11 05:59:31.595850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1659/3552] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:31.946655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:31.947210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:31.954117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:31.954596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:31.955032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:31.955715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:31.956194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:31.956620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:32.017633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:32.025931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-371f9a06-070a-43a0-af5f-b9e24e61441f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083231 Sep 11 05:59:32.026493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1894/3553] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:32.618776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:32.619394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:32.626449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:32.626932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:32.627377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:32.628092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:32.628568 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:32.628987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:32.761395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:32.769720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ffb89b5-6421-4ff1-9984-7d2297b887e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154861 Sep 11 05:59:32.770286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1660/3554] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:33.048857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:33.049415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:33.055793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:33.056306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:33.056740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:33.057423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:33.057873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:33.058296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:33.119962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:33.128930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45363a4d-6f1e-45ec-aab6-607ebc78efbf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084209 Sep 11 05:59:33.129494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1895/3555] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:33.793002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:33.793610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:33.800827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:33.801318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:33.801757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:33.802457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:33.802914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:33.803336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:33.806307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:33.934895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:33.943004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d73e01f-200e-4425-a878-6b41381eb94a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154053 Sep 11 05:59:33.943563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1661/3556] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:34.151834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:34.152469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:34.159838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:34.160347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:34.160778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:34.161455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:34.161906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:34.162326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:34.164841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:34.228782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:34.237071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d95f6a67-26b6-4686-b443-578c21c1e2b5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089033 Sep 11 05:59:34.237646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1896/3557] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:34.966497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:34.967654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:34.974736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:34.975227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:34.975661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:34.976409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:34.976861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:34.977286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:35.103922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:35.112280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6153f1e3-d05b-4fb0-b3ca-877f0d9463ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149628 Sep 11 05:59:35.112860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1662/3558] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:35.259783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:35.260433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:35.267431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:35.267920 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:35.268652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:35.269347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:35.269808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:35.270240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:35.333173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:35.341622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-436bc0dc-e41a-447e-9934-9c503a871f7f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085657 Sep 11 05:59:35.342239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1897/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:35 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:36.135430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:36.136067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:36.142757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:36.143515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:36.143957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:36.144674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:36.145138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:36.145567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:36.365311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:36.366080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:36.372793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:36.373325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:36.374698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:36.375414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:36.375871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:36.376324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:36.440487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:36.448884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60e5de85-70ef-4923-b004-cc2d83398ff5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087525 Sep 11 05:59:36.449464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1898/3560] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:36.511257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:36.520462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b893512c-a028-4859-8359-8169f9ff75ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.388961 Sep 11 05:59:36.521029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1663/3561] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:37.473024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:37.473649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:37.480113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:37.480605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:37.481047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:37.481768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:37.482232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:37.483358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:37.543422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:37.544069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:37.544434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:37.551427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:37.551921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:37.552782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:37.553546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:37.553637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be520768-7fc5-430a-88f5-adcf919b34b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084448 Sep 11 05:59:37.554007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:37.554459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1899/3562] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:37.554565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:37.685115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:37.693452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6452c28-5e3e-400b-ab4b-00a55d144155 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153927 Sep 11 05:59:37.694121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1664/3563] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:38.577137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:38.577826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:38.584164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:38.584653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:38.585091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:38.585789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:38.586243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:38.586674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:38.649875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:38.658210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-085e31cc-fb75-4c31-b3fd-c59e93f7ce30 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085516 Sep 11 05:59:38.658777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1900/3564] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:38.717804 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:38.718474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:38.724872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:38.725358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:38.725829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:38.726521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:38.726982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:38.727411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:38.858760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:38.869155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4da95893-84f6-454c-bd23-2cd742e02af4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155782 Sep 11 05:59:38.869721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1665/3565] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:39.681694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:39.682348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:39.689442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:39.689927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:39.690369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:39.691063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:39.691528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:39.691958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:39.753224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:39.761309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc7a54da-d8ce-4a4c-9ac5-9d36515640ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083526 Sep 11 05:59:39.761867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1901/3566] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:39.892759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:39.893664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:39.900120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:39.900641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:39.901087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:39.901787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:39.902250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:39.902680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:40.036117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:40.044294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b9d8dcc-5358-4bbc-9838-367668c135df tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155469 Sep 11 05:59:40.044867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1666/3567] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:40.785284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:40.785879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:40.792257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:40.792743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:40.793175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:40.793874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:40.794323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:40.794745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:40.857049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:40.866022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26478792-4e4d-431c-9edb-6bdf217983c3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084744 Sep 11 05:59:40.866579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1902/3568] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:41.067793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:41.068446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:41.074945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:41.075432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:41.075874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:41.077179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:41.077746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:41.078177 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:41.208097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:41.216192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05c4dfad-3689-45af-9555-7911a1d1baa4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152316 Sep 11 05:59:41.216766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1667/3569] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:41.889370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:41.889990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:41.896706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:41.897185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:41.897620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:41.898306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:41.898763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:41.899193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:41.963510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:41.972380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9f7f4de-e5e5-4bd5-a8a3-6ce5865c4d9a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086941 Sep 11 05:59:41.972942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1903/3570] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:42.239907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:42.240546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:42.246856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:42.247321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:42.247758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:42.248994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:42.249451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:42.249871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:42.379597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:42.387719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7deb128c-2133-4deb-b7a5-e34bc71a947a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151688 Sep 11 05:59:42.388303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1668/3571] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:42.995068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:42.995607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:42.997954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=74 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:43.004089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:43.004576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:43.005016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:43.005708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:43.006167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:43.006594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:43.070750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:43.079779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4ff4625-90b3-4e37-b165-f2cdcaa3db57 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088717 Sep 11 05:59:43.080361 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1904/3572] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:43.411540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:43.412180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:43.418509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:43.418984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:43.419416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:43.420380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:43.420838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:43.421261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:43.547900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:43.555960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b273bb1-8f75-4c58-8042-44fefca1ae5c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148348 Sep 11 05:59:43.556558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1669/3573] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:44.102349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:44.102964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:44.110253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:44.110731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:44.111164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:44.111869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:44.112351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:44.112781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:44.173475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:44.181609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d53cf69-3402-41ea-a15d-c2fab0ff2e6c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083181 Sep 11 05:59:44.182169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1905/3574] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:44.581187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:44.581832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:44.588270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:44.588755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:44.589194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:44.589883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:44.590338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:44.590762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:44.720963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:44.729053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb669d19-6717-4a56-a9d1-b68ea4db839a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151763 Sep 11 05:59:44.729628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1670/3575] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:45.206467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:45.207011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:45.213391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:45.213876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:45.214317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:45.215005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:45.215461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:45.215887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:45.276806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:45.285204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b9c2e2e-3700-46f5-9ea9-66a0cb6f1543 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082897 Sep 11 05:59:45.285768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1906/3576] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:45.752184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:45.752794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:45.755148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=64 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:45.760347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:45.760837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:45.761280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:45.761975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:45.762436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:45.762866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:45.890205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:45.898685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07cedc2f-658d-47b5-868a-f072b916768c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150501 Sep 11 05:59:45.899259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1671/3577] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:46.307992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:46.308652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:46.315011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:46.315490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:46.315925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:46.316632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:46.317089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:46.317511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:46.377649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:46.385705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6087e1f3-57ea-4cf9-9aa8-f4e66daf161f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081607 Sep 11 05:59:46.386260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1907/3578] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:46 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:46.923398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:46.924028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:46.930413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:46.930894 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:46.931334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:46.932465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:46.932566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:46.932964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:47.063964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:47.072102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9530bc80-463a-4aae-98ff-2bc0c258a61b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153306 Sep 11 05:59:47.072669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1672/3579] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:47.410014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:47.410635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:47.417008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:47.417500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:47.417943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:47.418669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:47.419129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:47.419571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:47.483053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:47.491907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32f2e683-623d-4755-995a-52f3cf2d97eb tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086648 Sep 11 05:59:47.492496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1908/3580] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:48.095443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:48.096089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:48.102480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:48.102970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:48.103415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:48.104145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:48.104614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:48.105045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:48.233237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:48.241581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f76b178-f4ba-40c5-81e8-fd6299abb07d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150054 Sep 11 05:59:48.242143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1673/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:48.514646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:48.515908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:48.522660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:48.523145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:48.523583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:48.524303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:48.524764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:48.525191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:48.588618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:48.597985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b022029-8dd2-4e1c-bd72-14c7a814f4ab tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087240 Sep 11 05:59:48.598574 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1909/3582] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:49.265581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:49.266419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:49.273060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:49.273539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:49.273970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:49.274655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:49.275108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:49.275537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:49.403908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:49.412015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4bcbe7cd-4b1f-401a-9c4b-a1d3862624ba tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150732 Sep 11 05:59:49.412580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1674/3583] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:49.620091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:49.620700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:49.627641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:49.628153 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:49.628590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:49.629275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:49.629728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:49.630152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:49.693085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:49.701307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7ee5eb6-d1d0-4275-aa32-d85dba816d7d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085058 Sep 11 05:59:49.701867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1910/3584] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:50.435932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:50.437072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:50.443498 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:50.443974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:50.444434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:50.445115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:50.445612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:50.446032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:50.580133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:50.588231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e95c52c-3cb2-4cea-a916-0153625a0c1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156200 Sep 11 05:59:50.588788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1675/3585] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:50.724561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:50.725121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:50.731542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:50.732046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:50.732485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:50.733167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:50.734335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:50.734900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:50.796910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:50.805185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-547ffd16-6f5f-473b-9bed-6a7a3b3b38a2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084677 Sep 11 05:59:50.805752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1911/3586] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:51.616409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:51.616943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:51.623239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:51.623715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:51.624372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:51.625072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:51.625522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:51.625939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:51.753247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:51.761381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a1b71997-6fa7-44a5-85e0-4a93e47f6c78 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148961 Sep 11 05:59:51.761945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1676/3587] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:51.829251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:51.829872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:51.836316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:51.836805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:51.837247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:51.837937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:51.838395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:51.838828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:51.903493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:51.905765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:51.913490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7140578-52b6-4977-b945-41162504448e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088813 Sep 11 05:59:51.914089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1912/3588] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:52.785449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:52.786057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:52.792473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:52.792956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:52.793389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:52.794080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:52.794527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:52.794952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:52.928127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:52.930390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 05:59:52.938418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:52.938945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b18e87b-0723-42bb-939c-5f65ed117639 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156847 Sep 11 05:59:52.939046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:52.939134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1677/3589] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:52.945515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:52.945995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:52.946428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:52.947115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:52.947565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:52.947986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:53.008764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:53.017954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9fc2b27-a5ab-491a-b7d5-33188bd9b013 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085006 Sep 11 05:59:53.018861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1913/3590] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:53.963125 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:53.963723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:53.971076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:53.971561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:53.972039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:53.972750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:53.973207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:53.973635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:54.041347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:54.041995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:54.049378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:54.049932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:54.050377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:54.051069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:54.051521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:54.051945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:54.104109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:54.113061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-240e963a-327f-4835-b15c-33da9a67f435 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154105 Sep 11 05:59:54.113629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1678/3591] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:54.114258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:54.122454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18ccc8c5-51e4-4de8-bdeb-88e7602727d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085080 Sep 11 05:59:54.123013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1914/3592] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:55.136298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:55.136903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:55.144683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:55.145011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:55.145404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:55.145591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:55.145747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:55.146286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:55.146740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:55.147169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:55.152050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:55.152537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:55.152972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:55.153657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:55.154110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:55.154533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:55.216371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:55.225343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cba76411-1e8e-4396-ba21-1bffb61a918e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084731 Sep 11 05:59:55.226508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1915/3593] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:55.274923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:55.283710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9459b681-b0f7-4e6d-afa0-6f8e88c7e27a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151347 Sep 11 05:59:55.284314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1679/3594] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:56.250132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:56.250930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:56.257676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:56.258161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:56.258597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:56.259295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:56.259753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:56.260212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:56.307176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:56.307790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:56.314912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:56.315442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:56.315879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:56.316745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:56.317202 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:56.317620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:56.329723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:56.337886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44913bab-2e3f-42c8-825d-f5edc7c78107 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.092680 Sep 11 05:59:56.338506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1916/3595] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:56 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:56.452862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:56.460981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a424e86-f563-4f01-9258-79698c23f66d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158300 Sep 11 05:59:56.461541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1680/3596] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 05:59:57.361088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:57.361706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:57.368098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:57.368587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:57.369027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:57.369717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:57.370172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:57.370601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:57.431650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:57.439811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e280a841-1c10-4dda-bf63-aad221751e70 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082683 Sep 11 05:59:57.440399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1917/3597] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:57.483980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:57.484610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:57.490898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:57.491377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:57.491813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:57.492523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:57.492976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:57.493404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:57.620159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:57.628300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97c02b86-61f8-4884-8b71-c1b51e95f393 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148245 Sep 11 05:59:57.628871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1681/3598] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:58.463365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:58.463971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:58.471330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:58.471808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:58.472278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:58.472951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:58.473401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:58.473821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:58.535969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:58.544340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d9b57d3-dc2c-41fa-ac7e-39147378fbd3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084857 Sep 11 05:59:58.544891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1918/3599] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:58.651971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:58.652599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:58.659516 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:58.660018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:58.660454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:58.661138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:58.661592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:58.662023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:58.792127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:58.800533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-451b49b4-43ec-4a94-a4dd-927897045b14 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152395 Sep 11 05:59:58.801106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1682/3600] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:59.568418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:59.568926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:59.574845 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:59.575282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:59.575720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:59.576429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:59.577432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:59.577916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:59.637040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:59.646249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afe55489-f549-4cd2-adc5-51ddef574707 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082106 Sep 11 05:59:59.646806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1919/3601] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 05:59:59.824313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 05:59:59.824957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 05:59:59.831951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:59.832462 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:59.832898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:59.833579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 05:59:59.834029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 05:59:59.834451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 05:59:59.961731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 05:59:59.970057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80e73336-0b93-497d-bce3-3e39262435b0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149557 Sep 11 05:59:59.970615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1683/3602] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 05:59:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:00.670351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:00.671759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:00.674152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:00:00.674296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 (ip 10.222.0.33) !!! Sep 11 06:00:00.680890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:00.681384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:00.681863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:00.682568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:00.683033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:00.683466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:00.749229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:00.757470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aef626ec-6e6e-472e-9e56-79eedbbcbf41 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.091204 Sep 11 06:00:00.758037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1920/3603] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:00.994559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:00.995167 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:01.001581 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:01.002004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:01.002441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:01.003132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:01.003585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:01.004045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:01.133493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:01.142104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c5bc69d-6c30-44e6-86ea-86ec9d0327a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151427 Sep 11 06:00:01.142671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1684/3604] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:01.780774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:01.781334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:01.787716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:01.788248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:01.788697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:01.789396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:01.789857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:01.790290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:01.851368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:01.860076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98daf03b-40ec-45e0-8717-933952dab4b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083408 Sep 11 06:00:01.860639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1921/3605] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:02.166073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:02.166686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:02.173291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:02.173772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:02.174211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:02.174897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:02.175353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:02.175777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:02.301577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:02.309748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e188258-1cff-4a9f-9428-fcd0b1de7a37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147624 Sep 11 06:00:02.310308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1685/3606] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:02.883541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:02.884190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:02.890721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:02.891213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:02.891650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:02.892392 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:02.892848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:02.893569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:02.954796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:02.962898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad93f213-4f61-4b06-9948-fbe7fed7ce55 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084071 Sep 11 06:00:02.963444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1922/3607] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:03.333969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:03.334577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:03.340978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:03.341456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:03.341890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:03.343361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:03.344060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:03.344492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:03.470712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:03.478792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-908509ac-d2c5-43df-920b-49ae9abc98cc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148725 Sep 11 06:00:03.479346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1686/3608] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:03.987043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:03.987651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:03.996609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:03.997094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:03.997528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:03.998215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:03.999168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:03.999835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:04.063180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:04.072993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52b61d5d-fbb4-49e8-9504-1da056205533 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089977 Sep 11 06:00:04.073741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1923/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:04.502012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:04.502625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:04.509029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:04.509514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:04.509953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:04.510653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:04.511106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:04.511532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:04.716617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:04.725751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-95d9b399-a105-4f06-a9b4-2f9500d55f7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.227583 Sep 11 06:00:04.726364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1687/3610] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:05.098067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:05.098683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:05.105117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:05.105599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:05.106041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:05.106797 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:05.107246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:05.107670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:05.171624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:05.179651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88d90e13-9e60-4682-81b5-5aa713c77bb0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085587 Sep 11 06:00:05.180241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1924/3611] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:05 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:05.750232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:05.750746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:05.757332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:05.757813 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:05.758249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:05.758936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:05.759392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:05.759817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:05.890993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:05.899393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07079dea-f18e-48c5-ac8d-1c7c348b9e0d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153783 Sep 11 06:00:05.899987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1688/3612] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:06.202928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:06.203544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:06.209899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:06.210380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:06.210823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:06.211516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:06.211971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:06.212425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:06.273680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:06.282582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e40703b2-9289-4ade-9bda-4afeb83e413a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083710 Sep 11 06:00:06.283147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1925/3613] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:06 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:06.922951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:06.923566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:06.929983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:06.930466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:06.930936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:06.931620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:06.932094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:06.932520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:07.057536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:07.066168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03abd36a-eb0d-4483-a085-f14156cd8f02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147457 Sep 11 06:00:07.066730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1689/3614] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:07.305620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:07.306255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:07.313428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:07.313855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:07.314292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:07.314987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:07.315441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:07.315865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:07.376535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:07.384798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-922803f7-de0a-42ca-8f50-506f8fa48a21 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083107 Sep 11 06:00:07.385350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1926/3615] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:07 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:08.089569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:08.090183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:08.097389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:08.097876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:08.098316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:08.099039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:08.099500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:08.099929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:08.225224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:08.233386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8730e6d7-26ee-4d82-a562-36398aae47f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147732 Sep 11 06:00:08.233953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1690/3616] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:08.408688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:08.409231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:08.415604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:08.416116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:08.416559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:08.417247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:08.417704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:08.418132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:08.479138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:08.487917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10e92907-0b66-48ef-a990-51e0e5bf2b81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083864 Sep 11 06:00:08.488513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1927/3617] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:08 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:09.256944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:09.257546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:09.264168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:09.264757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:09.265201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:09.265949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:09.266405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:09.266832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:09.397960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:09.406912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5bebf8a3-d7da-47a9-bb96-35afa11bbdf0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153804 Sep 11 06:00:09.407511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1691/3618] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:09.511274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:09.511844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:09.519237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:09.519726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:09.520200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:09.520889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:09.521345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:09.521774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:09.585479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:09.594723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fecc7a8-9db9-4307-9963-5a9123116f39 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087356 Sep 11 06:00:09.595288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1928/3619] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:09 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:10.430869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:10.431468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:10.438422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:10.438901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:10.439337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:10.440062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:10.440522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:10.440948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:10.571356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:10.580266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7dd33997-8d5e-494b-8496-c74a52cab5af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153253 Sep 11 06:00:10.580830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1692/3620] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:10.617399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:10.618010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:10.625240 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:10.625745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:10.626210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:10.626898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:10.627350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:10.627773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:10.643138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:10.692109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:10.700306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42c7847d-efea-4560-a0af-eac97b7d9826 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086747 Sep 11 06:00:10.700866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1929/3621] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:10 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:11.602599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:11.603207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:11.609604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:11.610081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:11.610513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:11.611191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:11.611639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:11.612089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:11.723385 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:11.724656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:11.730835 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:11.731330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:11.731778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:11.732508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:11.733013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:11.733452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:11.749479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:11.757805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b2a2946-b57c-43f9-be11-0f1335c65e49 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159044 Sep 11 06:00:11.758570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1693/3622] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:11.798630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:11.807087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea094154-61f5-4441-b349-5d08d3637a71 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087506 Sep 11 06:00:11.807664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1930/3623] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:11 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:12.782583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:12.783197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:12.790012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:12.790499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:12.790941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:12.791653 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:12.792124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:12.792552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:12.807987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:12.829888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:12.830601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:12.837233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:12.837762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:12.838209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:12.838922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:12.839383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:12.839819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:12.903421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:12.912619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-748d0423-2765-4e12-9b7d-cfd4f1fc0c53 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086820 Sep 11 06:00:12.913505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1931/3624] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:12 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:12.924410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:12.932556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bcb84ac8-a66e-45e2-ae99-c3c348b9e84f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154526 Sep 11 06:00:12.933151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1694/3625] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:13.935978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:13.936621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:13.938986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=56 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:13.944235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:13.944728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:13.945173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:13.945870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:13.946332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:13.946765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:13.955027 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:13.955626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:13.961912 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:13.962394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:13.962834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:13.963534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:13.963968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:13.964415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:14.012139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:14.021373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97748981-d52e-4c1e-8ece-e56aaadd4db6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089342 Sep 11 06:00:14.021932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1932/3626] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:13 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:14.092442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:14.101389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab4678c8-57c5-43f9-9a81-5c7e8337e49b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150772 Sep 11 06:00:14.101956 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1695/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:15.045173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:15.045783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:15.053147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:15.053627 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:15.054058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:15.054743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:15.055244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:15.055619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:15.117145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:15.124826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:15.125459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:15.125727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-356c1b6f-91e5-45ec-9239-f230273be6b9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084411 Sep 11 06:00:15.126299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1933/3628] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:15 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:15.131980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:15.132480 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:15.132910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:15.133627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:15.134081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:15.134529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:15.262870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:15.271419 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6787191d-753b-47cb-be28-9c58c217d340 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150456 Sep 11 06:00:15.271984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1696/3629] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:16.148857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:16.149575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:16.157229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:16.157719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:16.158158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:16.158856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:16.159309 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:16.159729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:16.220778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:16.228805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a176605-387b-4fe1-9550-b32ab280a9b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083885 Sep 11 06:00:16.229369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1934/3630] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:16 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:16.294587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:16.295187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:16.298870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:16.303878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:16.304382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:16.304820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:16.305507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:16.305957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:16.306379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:16.435622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:16.443720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c3bfcd0-2bf7-40d3-b353-0f86671a025e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152949 Sep 11 06:00:16.444313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1697/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:17.253781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:17.254411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:17.260793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:17.261272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:17.261705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:17.262394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:17.262847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:17.263271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:17.326001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:17.334693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0c4d25a-d83d-47bf-b20f-9dd18fd41f84 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085592 Sep 11 06:00:17.335249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1935/3632] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:17 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:17.466538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:17.467149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:17.473980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:17.474473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:17.474916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:17.475646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:17.476141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:17.476575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:17.605322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:17.613968 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fecaaec5-a690-4f44-8de6-ed786180e867 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151304 Sep 11 06:00:17.614544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1698/3633] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:18.358894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:18.360150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:18.366564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:18.367042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:18.367478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:18.368204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:18.368658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:18.369078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:18.432727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:18.440935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bbe4d5e-c228-4453-ab2c-d02863678cdf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086082 Sep 11 06:00:18.441498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1936/3634] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:18 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:18.637658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:18.638198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:18.645661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:18.646138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:18.646571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:18.647251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:18.647700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:18.648155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:18.775373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:18.783775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59fce44a-4e07-4d28-99c1-a820558b7d02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150030 Sep 11 06:00:18.784380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1699/3635] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:19.464411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:19.465020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:19.472168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:19.472655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:19.473088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:19.473769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:19.474219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:19.474642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:19.535464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:19.543667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4338cf7-c7a9-4b56-ae82-d82505457644 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083119 Sep 11 06:00:19.544251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1937/3636] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:19 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:19.806729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:19.807345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:19.813887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:19.814377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:19.814819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:19.815518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:19.815980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:19.816436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:19.949790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:19.958483 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9753845e-5dcb-45a6-b43c-8ffe6539c611 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155732 Sep 11 06:00:19.959047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1700/3637] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:20.567325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:20.567937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:20.574378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:20.574867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:20.575301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:20.576012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:20.576469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:20.576896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:20.637226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:20.645634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12f3c4e0-8e28-4269-98fe-5fba6fa2528d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083285 Sep 11 06:00:20.646199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1938/3638] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:20 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:20.982579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:20.983184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:20.990445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:20.990922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:20.991353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:20.992058 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:20.992510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:20.992930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:21.119078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:21.127344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e7dca23-8e0c-4609-92c0-76988673b370 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148591 Sep 11 06:00:21.127911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1701/3639] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:21.667965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:21.668531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:21.674910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:21.675400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:21.675840 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:21.676571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:21.677031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:21.677456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:21.737608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:21.745808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e01249ac-f0a3-48ca-a3f9-f2b2f67c63e5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081838 Sep 11 06:00:21.746370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1939/3640] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:21 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:22.152300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:22.153193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:22.160139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:22.160634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:22.161084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:22.161796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:22.162257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:22.162683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:22.304385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:22.313709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-91f6a420-f176-4729-a38d-3bba479aed17 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.165281 Sep 11 06:00:22.314291 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1702/3641] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:22.770227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:22.770837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:22.777826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:22.778351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:22.778800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:22.779501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:22.779963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:22.780426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:22.846272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:22.854343 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-181809bb-8dd7-4124-833d-f8ba28956580 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.089081 Sep 11 06:00:22.855230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1940/3642] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:22 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:23.343972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:23.344608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:23.350972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:23.351455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:23.351893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:23.352642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:23.353099 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:23.353524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:23.482207 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:23.490337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c60f3a7-c8ab-4cb7-870d-11d964a3701e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150312 Sep 11 06:00:23.490913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1703/3643] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:23.877158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:23.877773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:23.884138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:23.884617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:23.885053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:23.885739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:23.886191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:23.886614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:23.947781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:23.956588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53db4910-0505-42c6-a556-d961baa04d32 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083400 Sep 11 06:00:23.957150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1941/3644] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:23 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:24.513955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:24.514565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:24.521779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:24.522252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:24.522683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:24.523363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:24.523810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:24.524263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:24.657578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:24.665779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e40038e6-aefe-44bf-826e-1af98c3de6e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155769 Sep 11 06:00:24.666338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1704/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:24.978644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:24.979264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:24.985810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:24.986295 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:24.986735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:24.987424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:24.987882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:24.988339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:25.051402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:25.059648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ffb1c2a-587f-4a41-a8bf-1364bebe2adf tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084817 Sep 11 06:00:25.060182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1942/3646] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:24 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:25.689320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:25.689842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:25.697362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:25.697879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:25.698320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:25.699016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:25.699506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:25.699933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:25.832787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:25.840946 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d98096e5-d7a2-4b89-ad17-4202e61da088 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155601 Sep 11 06:00:25.841514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1705/3647] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:26.084050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:26.084665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:26.091091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:26.091577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:26.092032 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:26.092715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:26.093170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:26.094629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:26.158397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:26.166718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30a45328-8ea1-4c1d-bb75-d70838134d81 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086562 Sep 11 06:00:26.167287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1943/3648] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:26 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:26.864863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:26.865474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:26.871964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:26.872485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:26.872927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:26.873614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:26.874073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:26.874591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:27.007014 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:27.015942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85f9ed61-5de5-49c6-a91a-6abe9cad15fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154154 Sep 11 06:00:27.016574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1706/3649] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:27.189685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:27.190280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:27.196687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:27.197168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:27.197598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:27.198281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:27.198733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:27.199161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:27.263777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:27.272304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eeb23cb9-50f0-4249-9f78-1a30e5c67f0f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086882 Sep 11 06:00:27.272862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1944/3650] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:27 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:28.039253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:28.039855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:28.046764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:28.047523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:28.047966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:28.048677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:28.049131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:28.049559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:28.178731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:28.186863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff43a452-1f0b-4314-9394-271f96d0a455 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151387 Sep 11 06:00:28.188098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1707/3651] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:28.294211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:28.294831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:28.301992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:28.302485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:28.302925 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:28.303620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:28.304107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:28.304543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:28.365000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:28.373129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a332dbac-233e-47bd-ad48-fc9102ad14c9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082736 Sep 11 06:00:28.373692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1945/3652] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:28 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:29.210591 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:29.211133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:29.217644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:29.218160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:29.218620 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:29.219352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:29.219801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:29.220273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:29.348776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:29.356784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8dd3bfe-b00f-4cba-bac7-1d3d74ddaa6e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150201 Sep 11 06:00:29.357347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1708/3653] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:29.396847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:29.397467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:29.403359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:29.403844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:29.404329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:29.405020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:29.405476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:29.406604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:29.410482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:29.466740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:29.475333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de4e8fe1-1346-4050-840a-bc8dba3c6d20 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082734 Sep 11 06:00:29.475891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1946/3654] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:29 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:30.380967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:30.381574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:30.387618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:30.388138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:30.388580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:30.389268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:30.389727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:30.390221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:30.498706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:30.499950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:30.507823 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:30.508624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:30.509284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:30.510040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:30.510469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:30.511096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:30.522077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:30.530319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82b95910-7538-4b5a-ae2b-0f532f495ad9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153241 Sep 11 06:00:30.531059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1709/3655] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:30.574275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:30.582696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-603d0ffc-11fb-4879-826c-837f8ea09aff tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087853 Sep 11 06:00:30.583260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1947/3656] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:30 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:31.555908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:31.556546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:31.563778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:31.564294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:31.564730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:31.565415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:31.565872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:31.566298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:31.605332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:31.605872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:31.614832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:31.615330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:31.615770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:31.616513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:31.616972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:31.617401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:31.686010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:31.695578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2032ad5-23cc-401d-a1e2-f7c5d4c2508c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.094065 Sep 11 06:00:31.696265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1948/3657] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:31 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:31.700197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:31.709179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d6ac55d-ff2e-49a8-976a-eca3fb0f3ef6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157140 Sep 11 06:00:31.709741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1710/3658] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:32.719690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:32.720312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:32.727008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:32.727501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:32.727937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:32.728659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:32.729116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:32.729547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:32.732329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:32.732944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:32.739552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:32.740063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:32.740575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:32.741284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:32.741745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:32.742179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:32.744795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:32.794383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:32.803468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d96923a2-2d92-4c0a-accb-5fffda0dabfd tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.088711 Sep 11 06:00:32.804383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1949/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:32 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:32.874093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:32.882818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f784fe1-c717-435e-be89-4016720aabfc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154263 Sep 11 06:00:32.883382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1711/3660] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:33.826544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:33.827159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:33.834296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:33.834778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:33.835214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:33.835905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:33.836389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:33.836812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:33.898031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:33.906865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:33.907505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a00492f7-799b-4481-b85f-f307212382f2 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084653 Sep 11 06:00:33.907625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:33.907863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1950/3661] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:33 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:33.913997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:33.914475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:33.914911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:33.915603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:33.916072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:33.916497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:34.047025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:34.055172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6f6e0eb-0b59-42f4-b77a-f95ba545b10a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152874 Sep 11 06:00:34.055788 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1712/3662] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:34.930786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:34.931404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:34.937963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:34.938446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:34.938885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:34.939578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:34.940066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:34.940499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:35.001608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:35.009854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b07ec8b0-058d-4f0c-9274-9dfa31af15b3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083027 Sep 11 06:00:35.010414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1951/3663] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:34 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:35.078153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:35.078749 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:35.085002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:35.085508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:35.085941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:35.086624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:35.087072 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:35.087524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:35.215567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:35.223808 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38364b60-de3d-499d-8d98-6aa27511b358 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150032 Sep 11 06:00:35.224409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1713/3664] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:36.033798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:36.034331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:36.041097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:36.041584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:36.042020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:36.042701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:36.043150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:36.043569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:36.106816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:36.115877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-786a5382-21d9-4d40-af52-0d1899053b7c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086552 Sep 11 06:00:36.116458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1952/3665] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:36 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:36.246604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:36.247266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:36.254290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:36.254772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:36.255211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:36.255899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:36.256380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:36.256809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:36.386313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:36.395539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a495c3c9-2864-4f94-859e-8ff9309a1081 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152763 Sep 11 06:00:36.396122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1714/3666] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:37.138774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:37.139381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:37.146775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:37.147256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:37.147695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:37.148407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:37.148863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:37.149285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:37.210386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:37.219243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ccd0f61-0082-41ea-89d2-7a5d8308be74 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084202 Sep 11 06:00:37.219801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1953/3667] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:37.418582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:37.419162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:37.426066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:37.426545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:37.426983 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:37.427669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:37.428159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:37.428586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:37.558806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:37.567644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-163165aa-ff61-4687-8b68-cad8fb1be3ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152954 Sep 11 06:00:37.568367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1715/3668] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:38.241958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:38.242601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:38.248972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:38.249716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:38.250188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:38.250900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:38.251356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:38.251779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:38.312284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:38.320336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e635559f-eb00-458b-bf83-489b4a418792 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082179 Sep 11 06:00:38.320898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1954/3669] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:38 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:38.591477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:38.592133 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:38.599461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:38.599944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:38.600427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:38.601104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:38.601560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:38.601989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:38.728569 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:38.736663 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-796b3869-1aa8-4359-a110-803f2f48653e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149014 Sep 11 06:00:38.737227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1716/3670] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:39.069745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:39.070281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:39.076328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.076815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.077901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.078622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.079081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.079515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.101919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-057d8a5b-64dc-4ec1-9774-28800a401e68 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/ips" status: 200 len: 148 microversion: 2.1 time: 0.036131 Sep 11 06:00:39.102482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1955/3671] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:00:39 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:00:39.343825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:39.344475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:39.350458 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.350941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.351380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.352098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.352563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.352992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.413258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:39.421546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34308224-f0cc-4a0f-9a08-dbbeff564f64 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082381 Sep 11 06:00:39.422107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1717/3672] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:39 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:39.759384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:39.759911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:39.767109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.767595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.768058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.769006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:39.769466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:39.769895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:39.897000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:39.905633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5607a3a2-4361-4f45-bc30-35d66531cd36 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150227 Sep 11 06:00:39.906190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1956/3673] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:40.444188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:40.444834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:40.451367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:40.451859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:40.452381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:40.453085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:40.453546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:40.453976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:40.518882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:40.526994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d99b625f-802f-4409-9ade-bc3e288a7190 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086716 Sep 11 06:00:40.527551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1718/3674] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:40 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:40.930177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:40.930790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:40.937320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:40.937798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:40.938231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:40.938915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:40.939366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:40.939791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:41.069252 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:41.077987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6f9fa1d-8456-4d99-bfb3-9df1878849a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151186 Sep 11 06:00:41.078544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1957/3675] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:41.553521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:41.554138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:41.560527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:41.561015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:41.561549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:41.562752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:41.563215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:41.563646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:41.623577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:41.632304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad0872e3-c0ce-4d8a-a9e2-fe7b31a1b221 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082699 Sep 11 06:00:41.632871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1719/3676] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:41 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:42.102007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:42.102625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:42.109129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:42.109615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:42.110056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:42.110752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:42.111211 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:42.111643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:42.238459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:42.246598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6a680e1-094e-457a-84dd-2cfc2dc376ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148560 Sep 11 06:00:42.247154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1958/3677] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:42.655943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:42.656625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:42.663070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:42.663557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:42.664019 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:42.664713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:42.665168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:42.665593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:42.729608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:42.738918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b201263-b304-49eb-b694-b06852011596 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.087564 Sep 11 06:00:42.739485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1720/3678] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:42 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:43.270609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:43.271220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:43.277640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:43.278122 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:43.278559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:43.279247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:43.279702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:43.280277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:43.410375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:43.418528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-569b286a-1fad-40d0-8262-51a35355e8a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152002 Sep 11 06:00:43.419096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1959/3679] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:43.761932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:43.762538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:43.769521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:43.769997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:43.770429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:43.771109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:43.771562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:43.771982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:43.836305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:43.845083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-394eae13-e483-4f95-860e-9c8ef7a3ec60 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086995 Sep 11 06:00:43.845645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1721/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:43 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:44.442707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:44.443317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:44.445616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=56 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:44.450737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:44.451258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:44.451696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:44.453061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:44.453509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:44.453933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:44.580586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:44.588677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d271567-6b9f-402a-8abb-0add860ad367 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149882 Sep 11 06:00:44.589246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1960/3681] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:44.867883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:44.868533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:44.875295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:44.875777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:44.876253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:44.876944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:44.877405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:44.877832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:44.941387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:44.949455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d03cf973-4e27-406e-9a90-0b560006594b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085443 Sep 11 06:00:44.950015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1722/3682] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:44 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:45.612981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:45.613526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:45.619978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:45.620499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:45.620939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:45.621629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:45.622085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:45.622514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:45.753370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:45.761599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-170f6ed4-3072-4489-b689-fab9fcebb473 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152579 Sep 11 06:00:45.762166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1961/3683] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:45.977885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:45.978474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:45.985933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:45.986441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:45.986878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:45.987566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:45.988043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:45.988567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:46.049677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:46.058012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-948c1bdb-ddf1-4e60-a676-87b97ddad0f9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084171 Sep 11 06:00:46.058552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1723/3684] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:45 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:46.784753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:46.785366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:46.791948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:46.792469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:46.792911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:46.793617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:46.794076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:46.794500 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:46.924525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:46.932695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11740a1b-0daf-4924-b42d-972435fbd44a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151852 Sep 11 06:00:46.933260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1962/3685] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:47.079447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:47.080074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:47.082394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=54 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:47.087563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:47.088064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:47.088501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:47.089210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:47.089662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:47.090080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:47.152098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:47.160654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-100335f8-6a32-4123-bb90-4248e115a95e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085037 Sep 11 06:00:47.161216 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1724/3686] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:47 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:47.957681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:47.958310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:47.964619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:47.965105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:47.965547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:47.966244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:47.966703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:47.967110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:47.970035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:48.099510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:48.109214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d98199c1-7715-4c66-9696-91c8be1c879d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154590 Sep 11 06:00:48.110282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1963/3687] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:48.186553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:48.187452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:48.194592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:48.195093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:48.195615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:48.196433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:48.196898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:48.197334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:48.261078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:48.270769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58b754d4-251f-4f42-bf76-c10974eaa8c6 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.090064 Sep 11 06:00:48.271340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1725/3688] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:48 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:49.132995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:49.133605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:49.140413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:49.140909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:49.141347 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:49.142035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:49.142488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:49.142911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:49.294623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:49.295353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:49.302714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:49.303213 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:49.303650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:49.304384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:49.304848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:49.305274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:49.376774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:49.385327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-95664c09-c990-4a84-b53c-b7cdd7d3c09c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.094824 Sep 11 06:00:49.385834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1726/3689] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:49 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:00:49.512889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:49.522227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-323f8401-d222-45d9-a25e-b65a6b071ff2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.393241 Sep 11 06:00:49.522803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1964/3690] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:50.409704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:50.410407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:50.416709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:50.417184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:50.417612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:50.418290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:50.418736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:50.419152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:50.478481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:50.480641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:00:50.487802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c5790a1-f645-42ae-860d-f54b93b0d81b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081937 Sep 11 06:00:50.488396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1727/3691] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:50 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:50.547099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:50.547705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:50.554101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:50.554584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:50.555049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:50.555718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:50.556208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:50.556643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:50.686004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:50.694909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77f6f890-8731-47da-a055-1ca86a007f1e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152208 Sep 11 06:00:50.695480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1965/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:51.511972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:51.512607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:51.520351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:51.520836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:51.521275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:51.521964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:51.522448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:51.522876 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:51.583814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:51.591866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6d89508-0ff1-4c56-ab9a-8216ce1484a8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083768 Sep 11 06:00:51.592468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1728/3693] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:51 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:51.717676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:51.718393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:51.724727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:51.725214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:51.725655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:51.726345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:51.726807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:51.727237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:51.855796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:51.864108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c11242e3-5ec9-4f7c-9c63-d3c78daff8a4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150364 Sep 11 06:00:51.864668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1966/3694] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:52.615758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:52.616405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:52.622667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:52.623147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:52.623587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:52.624502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:52.624962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:52.625386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:52.686484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:52.694651 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b190eb6-e650-41dc-8487-fc83a603370e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082787 Sep 11 06:00:52.695217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1729/3695] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:52 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:52.887989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:52.888559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:52.895839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:52.896356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:52.896789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:52.897471 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:52.897923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:52.898352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:53.024635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:53.033667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08ff7cb0-dfd7-4f64-98ae-2901f597743e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149676 Sep 11 06:00:53.034225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1967/3696] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:53.717577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:53.719007 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:53.725080 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:53.725564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:53.726020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:53.726689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:53.727143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:53.727565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:53.791644 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:53.799975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4067706-adfa-43c7-99aa-e25bb8e79fba tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.086277 Sep 11 06:00:53.800575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1730/3697] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:53 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:54.056994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:54.057534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:54.064888 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:54.065368 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:54.065802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:54.066483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:54.066941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:54.067364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:54.194811 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:54.203646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94656d37-55ff-4b4e-8334-ccf9cf9a5202 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150633 Sep 11 06:00:54.204237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1968/3698] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:54.822752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:54.823389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:54.830447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:54.830918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:54.831352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:54.832063 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:54.832518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:54.832939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:54.895280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:54.903473 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-068f8476-e9cc-4e6d-abd1-5b4ead5a1f07 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.084648 Sep 11 06:00:54.904054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1731/3699] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:54 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:55.226497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:55.227111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:55.233991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:55.234474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:55.234938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:55.235637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:55.236125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:55.236556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:55.364204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:55.372362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-941105b5-3978-4688-91c0-c20f2da457dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149690 Sep 11 06:00:55.372924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1969/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:55.927666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:55.928299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:55.934608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:55.935092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:55.935526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:55.936844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:55.937385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:55.937775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:55.997215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:56.006077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd42be0f-26fe-49ee-9988-527d10a5fd96 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082229 Sep 11 06:00:56.006583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1732/3701] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:55 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:56.395875 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:56.396529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:56.402924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:56.403412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:56.403853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:56.404591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:56.405552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:56.405982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:56.535499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:56.543704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ca3f6a8-6626-4f61-aa39-d13a2d7d30a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152083 Sep 11 06:00:56.544303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1970/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:57.028913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:57.029520 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:57.035825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:57.036325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:57.036762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:57.037448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:57.037908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:57.038330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:57.100219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:57.108276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a554e5c2-5ee4-4950-9049-e437045acc75 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083250 Sep 11 06:00:57.108846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1733/3703] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:57 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:57.566860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:57.567478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:57.573986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:57.574481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:57.574914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:57.575597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:57.576081 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:57.576510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:57.706030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:57.714458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5190df5-0593-4c54-9653-b5f1d35a54dd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151447 Sep 11 06:00:57.715030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1971/3704] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:58.130830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:58.131431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:58.137839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:58.138325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:58.138770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:58.139466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:58.139926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:58.140379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:58.204774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:58.212981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bdfa36de-a1ca-4c11-9bf5-b3914b2110ad tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085987 Sep 11 06:00:58.213503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1734/3705] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:58 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:58.738542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:58.739154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:58.745256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:58.745746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:58.746183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:58.746874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:58.747329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:58.747757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:58.875290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:58.883432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5109398-7e4e-4205-82c3-3bed4bc24bc8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149045 Sep 11 06:00:58.884009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1972/3706] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:59.239721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:59.240290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:59.246645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:59.247131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:59.247576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:59.248300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:59.248764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:59.249238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:59.310414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:00:59.318829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d4a51ba-8756-4865-84a8-e7440d589578 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083122 Sep 11 06:00:59.319402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1735/3707] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:59 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:00:59.907769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:00:59.908410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:00:59.914781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:59.915268 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:59.915715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:00:59.916430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:00:59.916891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:00:59.917434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:00.054861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:00.063799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8012f8b-27fd-492e-b316-253891921463 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.160509 Sep 11 06:01:00.064329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1973/3708] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:00:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:00.341627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:00.342242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:00.348226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:00.348712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:00.349154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:00.349843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:00.350309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:00.350738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:00.410578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:00.418595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-817e1f9a-fb03-4a71-bfbc-e15dcb8c8305 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.081092 Sep 11 06:01:00.419157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1736/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:00 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:01.087342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:01.087955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:01.094520 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:01.095008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:01.095444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:01.096165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:01.096622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:01.097045 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:01.225720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:01.234623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8cb1ea8-9eb3-4593-b88d-2a1b42c3f5d2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151121 Sep 11 06:01:01.235186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1974/3710] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:01.442150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:01.442758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:01.449121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:01.449607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:01.450045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:01.450733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:01.451191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:01.451617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:01.512239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:01.521258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ddd95e02-eedf-4f24-a167-56251f0ae67b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.083007 Sep 11 06:01:01.521816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1737/3711] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:01 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:02.257933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:02.258552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:02.264956 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:02.265441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:02.265879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:02.266570 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:02.267027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:02.267455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:02.393012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:02.401444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c1a243e-f0a5-4894-90af-7c1d7779ed9e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147412 Sep 11 06:01:02.402012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1975/3712] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:02.543215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:02.543741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:02.550184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:02.550667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:02.551100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:02.551778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:02.552320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:02.552745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:02.616148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:02.624688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05850fe5-726e-40bc-9130-6cc3770a3b51 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.085398 Sep 11 06:01:02.625252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1738/3713] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:02 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:03.425805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:03.426453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:03.432872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:03.433358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:03.433801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:03.434506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:03.434949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:03.435376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:03.567517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:03.575806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b371bf77-5087-4cc6-b2d0-34471b5bbdce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153851 Sep 11 06:01:03.576401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1976/3714] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:03.648113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:03.648668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:03.655617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:03.656139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:03.656580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:03.657279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:03.657738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:03.658170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:03.718460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:03.726573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c043dbf1-2d53-4539-a3bc-4ecfe5ebe8a0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.082615 Sep 11 06:01:03.727141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1739/3715] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:03 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:04.599145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:04.599765 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:04.606258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:04.606749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:04.607192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:04.608041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:04.608730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:04.609170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:04.744556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:04.749952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:04.750590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:04.754682 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-807a02a6-806d-438b-b975-c8d6252935f0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159297 Sep 11 06:01:04.755399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1977/3716] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:04.757503 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:04.757995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:04.758438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:04.759143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:04.759606 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:04.760062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:04.836205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:04.844362 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-388191e5-303d-4a79-8a46-e9fe5c6e5b99 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 200 len: 1368 microversion: 2.1 time: 0.098696 Sep 11 06:01:04.844930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1740/3717] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:04 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:01:04.867971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f00a1618-4470-44c8-bc24-a6f1d589b340 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '.version_select at 0x7f2c3f5cd040>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:04.888479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f00a1618-4470-44c8-bc24-a6f1d589b340 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993328104" status: 202 len: 0 microversion: 2.1 time: 0.024263 Sep 11 06:01:04.889065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1978/3718] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 11 06:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993328104 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:01:05.700208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d19a25d-e439-4430-941a-ca96a665b449 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: .version_select at 0x7f2c429a0940>, body: {"keypair": {"name": "tempest-keypair-1818428914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5mpZKBirIx20A4DD6XxCMUWbaI8hARD15VEuwm1QYOLG7xQq10HUvIWcX/kdcKHrNpVHpC9HOhAugZ7m5dk84/Cu83w/e+hNi08Js86r8lECXQfitkmcumaAaXw2hDQw=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:01:05.716391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-8d19a25d-e439-4430-941a-ca96a665b449 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:01:05.721018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-8d19a25d-e439-4430-941a-ca96a665b449 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for user 32df696da09746748786b94aa8b6721d and project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:01:05.743150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d19a25d-e439-4430-941a-ca96a665b449 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046924 Sep 11 06:01:05.743780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1741/3719] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 06:01:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:01:05.780537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:05.781161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:05.787105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:05.787598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:05.788100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:05.789230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:05.790055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:05.790498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:05.984654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:05.993729 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d26860d-4859-4b53-9db2-69cd9b9b46ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.218087 Sep 11 06:01:05.994313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1979/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:07.018034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:07.019018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:07.025033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:07.025522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:07.025963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:07.026660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:07.027117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:07.027545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:07.247247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:07.256360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d67f95f-e929-4108-95ad-963bfdce2ec3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.243300 Sep 11 06:01:07.256935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1742/3721] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:07.364549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1446778729", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8d1f3f0-5341-458c-96ea-8e56a8e64464"}], "security_groups": [{"name": "tempest-securitygroup--1447509011"}], "key_name": "tempest-keypair-1818428914", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:01:07.473676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] validate_networks() for [('e8d1f3f0-5341-458c-96ea-8e56a8e64464', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 06:01:07.872673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 06:01:07.874298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 06:01:07.874877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 06:01:07.875339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 06:01:07.876202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 06:01:07.885568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:07.885995 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:07.886518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:07.887247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:07.887701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:07.888161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:07.909226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:01:07.913202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Getting quotas for user 32df696da09746748786b94aa8b6721d and project d47e270753bc4fe6ac5ba1f2b0d5d2af. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:01:07.927251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 06:01:07.929828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 06:01:07.979715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9a61e60-8ad0-4710-a8a7-5df851fe06d9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619322 Sep 11 06:01:07.980396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1980/3722] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 06:01:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 06:01:07.993724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3a5d491-0228-4c6d-a8ec-cca2fd13e332 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:07.995446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3a5d491-0228-4c6d-a8ec-cca2fd13e332 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:08.052640 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3a5d491-0228-4c6d-a8ec-cca2fd13e332 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:08.059924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3a5d491-0228-4c6d-a8ec-cca2fd13e332 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1238 microversion: 2.1 time: 0.071311 Sep 11 06:01:08.060717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1743/3723] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:07 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:08.280666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:08.281289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:08.287970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:08.288494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:08.288946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:08.289744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:08.290115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:08.290543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:08.305232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:08.431165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:08.440193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee9778b5-6b92-4135-b204-09f8c1c226fa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.163486 Sep 11 06:01:08.440772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1981/3724] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:09.083811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:09.084443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:09.091470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:09.091949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:09.092616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:09.093306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:09.093756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:09.094178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:09.157364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:09.164917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73255aba-dda1-40c7-a233-71f995ba3933 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1290 microversion: 2.1 time: 0.084961 Sep 11 06:01:09.165467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1744/3725] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:09 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:09.466074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:09.466697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:09.473974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:09.474480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:09.474929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:09.475652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:09.476176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:09.476613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:09.612532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:09.620853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcc7d778-2526-4be4-bc10-afa71db55ea9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158649 Sep 11 06:01:09.621418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1982/3726] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:10.188468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:10.188993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:10.195654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:10.196595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:10.197240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:10.198029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:10.198645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:10.199073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:10.428999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:10.437433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfbd4954-9144-4bbf-9c2c-babf210b6cc0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.253480 Sep 11 06:01:10.438009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1745/3727] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:10 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:10.645850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:10.646559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:10.653646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:10.654227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:10.654719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:10.655583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:10.656157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:10.656658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:10.784977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:10.793544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d416acf2-d790-4f3b-ac9f-9a20086a2627 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151957 Sep 11 06:01:10.794135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1983/3728] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:10.873647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b09ca0e-78cf-4155-8c2f-522d8530e750", "tag": "684cd5fe-f324-47e4-8aaa-c050ebc7cf3c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:01:10.886961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:10.887470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:10.887880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:10.900214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] Creating event network-changed:684cd5fe-f324-47e4-8aaa-c050ebc7cf3c for instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 on hv-cinder-85692 Sep 11 06:01:10.906209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-e075fb0f-0712-4a69-8d88-ead087843e05 req-de3e5fda-6081-48b0-8f55-38b603363065 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037593 Sep 11 06:01:10.906809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1746/3729] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:01:11.460377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:11.461002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:11.466965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:11.467965 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:11.468589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:11.469283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:11.469775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:11.470204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:11.610612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:11.618348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76042969-4269-4202-a934-7a4858f46ff9 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.161871 Sep 11 06:01:11.618860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1984/3730] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:11 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:11.818218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:11.818917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:11.825035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:11.825513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:11.825951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:11.827252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:11.827770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:11.828225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:11.830807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:11.956810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:11.964910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9dae6ed-af74-4ffd-b002-aac63f1eacf1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151482 Sep 11 06:01:11.965472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1747/3731] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:12.641379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:12.641992 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:12.649030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:12.649535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:12.649974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:12.650703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:12.651152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:12.651573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:12.782348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:12.790171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1728266f-f1bf-4b55-94fb-6e129e8af822 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.152967 Sep 11 06:01:12.790962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1985/3732] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:12 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:12.989013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:12.989548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:12.995847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:12.996634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:12.997078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:12.997764 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:12.998203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:12.999351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:13.127032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:13.135149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81bf00a1-c09e-4e42-874d-e49e7d3b2e7f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150403 Sep 11 06:01:13.135714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1748/3733] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:13.813299 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:13.813919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:13.820426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:13.820917 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:13.821362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:13.822055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:13.822518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:13.822949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:13.953110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:13.960954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f4b0cce-e4fb-42b4-8061-c23dceab5d47 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.151552 Sep 11 06:01:13.961509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1986/3734] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:13 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:14.159562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:14.160219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:14.166580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:14.167066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:14.167506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:14.168226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:14.168688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:14.169121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:14.381614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:14.390852 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-171e48d2-5641-4fc3-ba94-5839a7652fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.236097 Sep 11 06:01:14.391594 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1749/3735] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:14.985006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:14.985629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:14.987937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:14.994040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:14.994552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:14.994990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:14.995708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:14.996186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:14.996609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:15.125649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:15.133246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec6434cd-e261-4e09-a473-aab85dc193d5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.152737 Sep 11 06:01:15.133804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1987/3736] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:14 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:15.414102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:15.414705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:15.421342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:15.421825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:15.422256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:15.422940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:15.423390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:15.423809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:15.709363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:15.718621 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-70e28faa-dd84-4aef-8271-33e71551a329 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.307192 Sep 11 06:01:15.719191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1750/3737] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:16.156732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:16.157292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:16.165427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:16.166028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:16.166539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:16.167335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:16.167866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:16.168372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:16.297123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:16.305446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e3d81ee-36d7-44b4-a2f3-cb258c001562 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.153132 Sep 11 06:01:16.306178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1988/3738] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:16 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:16.741975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:16.742590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:16.749015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:16.749501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:16.749944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:16.750635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:16.751096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:16.751524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:16.882527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:16.890908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-119ba6b8-8868-49f6-b2b8-73eabb87af0f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152796 Sep 11 06:01:16.891470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1751/3739] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:17.329954 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:17.330573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:17.336915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:17.337408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:17.337844 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:17.338540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:17.338998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:17.339427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:17.471737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:17.479329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78a934f0-854b-4867-b730-eff473a437d0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.154185 Sep 11 06:01:17.479890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1989/3740] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:17 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:17.914589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:17.915194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:17.917972 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:17.923767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:17.924274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:17.924711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:17.925398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:17.925846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:17.926263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:18.058052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:18.060239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:18.068465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f32bc57b-e774-4b5d-a66b-87bd9c1ccc8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157645 Sep 11 06:01:18.069028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1752/3741] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:18.501915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:18.502536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:18.507707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:18.509028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:18.511322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:18.512135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:18.512799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:18.514281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:18.515145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:18.515802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:18.658646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b09ca0e-78cf-4155-8c2f-522d8530e750", "name": "network-vif-plugged", "status": "completed", "tag": "684cd5fe-f324-47e4-8aaa-c050ebc7cf3c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:01:18.662388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:18.669124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:18.669596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:18.670661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:18.671057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee117a16-ec2a-4db8-976e-b71f3a4f0a8f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.172587 Sep 11 06:01:18.671722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1990/3742] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:18 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:18.682081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] Creating event network-vif-plugged:684cd5fe-f324-47e4-8aaa-c050ebc7cf3c for instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 on hv-cinder-85692 Sep 11 06:01:18.687218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-89017ae4-37de-4ce3-bc85-58d798846197 req-8eda027e-86ae-4cd1-84a5-ac188c5fb2d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034219 Sep 11 06:01:18.687786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1753/3743] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:01:19.093220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:19.093912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:19.099861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:19.100367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:19.100810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:19.101489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:19.101944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:19.102362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:19.233441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:19.241578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b50e0f90-6bf2-4b0e-bfe4-2521cb81adad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152314 Sep 11 06:01:19.242137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1991/3744] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:19.695642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:19.696499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:19.703033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:19.703518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:19.703957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:19.704685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:19.705138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:19.705563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:19.833346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:19.840844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e009a1fd-2d1d-4a7a-b521-52c2fd913370 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.150013 Sep 11 06:01:19.841401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1754/3745] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:19 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:20.266113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:20.266727 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:20.273420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:20.273884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:20.274323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:20.275013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:20.275469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:20.275898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:20.405294 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:20.413499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2edfd970-05f2-4f10-a337-20c356672e03 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151938 Sep 11 06:01:20.414063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1992/3746] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:01:20.864710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:20.865328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:20.872329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:20.872820 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:20.873869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:20.874566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:20.875018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:20.875440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:21.006060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:21.014773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9edfa52a-faa9-4d88-be54-e953d7e5c4c5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1364 microversion: 2.1 time: 0.153354 Sep 11 06:01:21.015348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1755/3747] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:20 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:21.436847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:21.437461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:21.443774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:21.444287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:21.444723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:21.445405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:21.445851 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:21.446275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:21.575886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:21.585289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbcbe6a5-1ca8-4e42-ad8f-d988a245057e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152318 Sep 11 06:01:21.585898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1993/3748] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:22.038117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:22.038731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:22.045455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.045936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.046400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.047090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.047549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.047975 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.180478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:22.188157 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-06d40da6-489e-45b1-80cb-727a1dd0f04a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1551 microversion: 2.1 time: 0.153929 Sep 11 06:01:22.188713 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1756/3749] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:22 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:22.210665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:22.211160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:22.217848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.218410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.218850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.219536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.220005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.220446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.296016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c64ce87e-74f1-4db9-8ed0-3ea914bfee5c tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089143 Sep 11 06:01:22.296606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1994/3750] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 06:01:22 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:01:22.609358 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:22.609966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:22.615800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.616320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.616760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.617446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:22.617899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:22.618324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:22.756469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:22.766319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a96ee79-8239-4838-8b1e-8d5736e61651 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161000 Sep 11 06:01:22.766959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1757/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:23.296879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b09ca0e-78cf-4155-8c2f-522d8530e750", "tag": "684cd5fe-f324-47e4-8aaa-c050ebc7cf3c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:01:23.306686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:23.307154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:23.307594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:23.319478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] Creating event network-changed:684cd5fe-f324-47e4-8aaa-c050ebc7cf3c for instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 on hv-cinder-85692 Sep 11 06:01:23.324953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-bffb5968-7dda-4750-9388-9a6548defc7e req-ef84a408-84d8-4864-ba81-5ec1feb24327 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084882 Sep 11 06:01:23.325571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1995/3752] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:01:23.791484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:23.792812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:23.803780 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:23.804341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:23.804534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:23.805245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:23.805704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:23.806128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:23.978389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:23.992277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c30a7246-5f82-4ab6-8ad5-e29f86dbd6ff tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.205306 Sep 11 06:01:23.993232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1758/3753] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:25.016518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:25.017255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:25.023652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:25.024189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:25.024635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:25.025326 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:25.025783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:25.026208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:25.157009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:25.165279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ea397bd-9c4c-450a-92cd-99d07ae5237a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154091 Sep 11 06:01:25.165837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1996/3754] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:26.188720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:26.189327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:26.195724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:26.196247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:26.196692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:26.197388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:26.197850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:26.198282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:26.324457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:26.332547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-837bde4b-c3b7-44af-84f9-bee06459c12d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147820 Sep 11 06:01:26.333114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1759/3755] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:27.357008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:27.357754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:27.364041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:27.364528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:27.364968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:27.365656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:27.366131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:27.366538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:27.492802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:27.501238 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dda6a10-f9f4-4c6e-9c60-df00f375f309 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148084 Sep 11 06:01:27.501805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1997/3756] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:01:28.525474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:28.526083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:28.533296 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:28.533777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:28.534215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:28.534905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:28.535361 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:28.535786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:28.665278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:28.674332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-787b0e25-96ea-4a36-bc8b-d3e2eef3c0d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152735 Sep 11 06:01:28.674917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1760/3757] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:29.698117 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:29.698728 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:29.704986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:29.705470 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:29.705902 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:29.706587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:29.707037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:29.707456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:29.840697 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:29.848957 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bf07316-61b6-49a9-96ff-47afcf4e0379 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154710 Sep 11 06:01:29.849550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1998/3758] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:30.872351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:30.873645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:30.879730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:30.880254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:30.880692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:30.881378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:30.881829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:30.882253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:31.007456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:31.016179 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2c496716-0c50-49c2-9c35-c4d29cc1d8ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147808 Sep 11 06:01:31.016746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1761/3759] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:32.039711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:32.040363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:32.047452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:32.047933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:32.048397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:32.049086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:32.049540 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:32.049966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:32.052622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:32.178501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:32.187119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-845fcf95-5466-41da-bded-ebfd62c3ac39 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151322 Sep 11 06:01:32.187684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1999/3760] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:33.209928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:33.210549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:33.217553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:33.218042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:33.218489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:33.219189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:33.219650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:33.220104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:33.351006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:33.359508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38905a6c-166f-4bad-9bd7-5e38eba7cf32 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153541 Sep 11 06:01:33.360086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1762/3761] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:34.383781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:34.384455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:34.391236 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:34.391692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:34.392168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:34.392953 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:34.394172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:34.394172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:34.524606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:34.533590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-888b1639-ef04-47a0-abe4-ebbf94c5893d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153699 Sep 11 06:01:34.534158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2000/3762] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:35.557263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:35.557904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:35.565135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:35.565618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:35.566060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:35.566755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:35.567215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:35.567643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:35.695885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:35.704544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef3a2511-5b34-4961-88d3-76e659e845a3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151130 Sep 11 06:01:35.705113 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1763/3763] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:36.726862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:36.727376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:36.733785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:36.734266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:36.734699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:36.735388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:36.735839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:36.736293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:36.865353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:36.873521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3259858b-484e-4ea5-b8cd-1587965f55ad tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150568 Sep 11 06:01:36.874591 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2001/3764] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:37.897878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:37.898443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:37.904761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:37.905318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:37.906622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:37.907327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:37.907783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:37.908245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:37.923165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:38.039441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:38.047645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3fa7acda-3b19-4de6-809f-45c49a449290 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153930 Sep 11 06:01:38.048237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1764/3765] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:39.070015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:39.070655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:39.077027 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:39.078510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:39.078968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:39.079658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:39.080141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:39.080569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:39.207383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:39.215578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43f95e45-af6e-4897-a8af-209f48e65280 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149398 Sep 11 06:01:39.216173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2002/3766] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:40.239958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:40.240590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:40.243041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:01:40.243189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 (ip 10.222.0.33) !!! Sep 11 06:01:40.249111 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:40.249627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:40.250088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:40.250765 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:40.251222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:40.251650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:40.389053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:40.398470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08c59a1f-61d4-4a88-b9b7-c68fe985f93b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.162424 Sep 11 06:01:40.399031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1765/3767] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:41.422009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:41.422640 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:41.429453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:41.429944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:41.430412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:41.431108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:41.431571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:41.432022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:41.562531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:41.570707 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f62d299-ada6-49d2-9b74-b538a2eead93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152755 Sep 11 06:01:41.571279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2003/3768] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:42.596209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:42.596842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:42.603464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:42.603965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:42.604407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:42.605092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:42.605541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:42.605964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:42.736535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:42.744597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-532d7d1b-ca07-449e-bcc1-5074482c6187 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153044 Sep 11 06:01:42.745166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1766/3769] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:43.768429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:43.769224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:43.775672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:43.776200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:43.776647 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:43.777344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:43.777807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:43.778237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:43.907628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:43.915791 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f77e52a9-7ba5-40b5-926d-514df186ac07 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151527 Sep 11 06:01:43.916381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2004/3770] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:44.939339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:44.939958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:44.946320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:44.946805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:44.947250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:44.947947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:44.948434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:44.948870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:45.078977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:45.087054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8035339f-0cb2-4da8-84c4-59baf9744036 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152465 Sep 11 06:01:45.087618 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1767/3771] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:46.111577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:46.112234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:46.114546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=36 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:46.120262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:46.120746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:46.121180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:46.121867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:46.122322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:46.122750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:46.253934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:46.262144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c95e02dd-8e1b-4ccb-8898-d3faf9a88443 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155054 Sep 11 06:01:46.262713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2005/3772] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:47.367178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:47.367802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:47.374200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:47.374689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:47.375165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:47.375860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:47.376344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:47.376775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:47.505194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:47.513875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff7e9899-84a8-449b-89c9-d8ea079c8ee2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.231411 Sep 11 06:01:47.514441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1768/3773] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:48.537567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:48.538172 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:48.544559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:48.545040 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:48.545476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:48.546160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:48.546609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:48.547733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:48.717960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:48.726928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b69ff5ea-30b8-4385-a1d9-2d92fb170028 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.193245 Sep 11 06:01:48.727498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2006/3774] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:49.751418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:49.751939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:49.754246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=34 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:01:49.759435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:49.759921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:49.760386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:49.761082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:49.761538 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:49.761966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:49.888826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:49.897253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c00ec46f-5d2d-44f6-a133-6d59a573207f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150614 Sep 11 06:01:49.897818 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1769/3775] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:50.920449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:50.921066 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:50.928203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:50.928690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:50.929131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:50.929827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:50.930289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:50.930718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:51.056454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:51.065164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08f0464e-9fa9-4e4e-a50c-29191833d65c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148653 Sep 11 06:01:51.065726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2007/3776] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:52.089040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:52.089659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:52.097522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:52.098212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:52.098815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:52.099451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:52.100093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:52.100587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:52.231905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:52.240025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-569e79ee-d1c8-4019-8f25-65a891c5bb02 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154888 Sep 11 06:01:52.240588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1770/3777] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:53.263226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:53.263834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:53.271508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:53.271985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:53.272443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:53.273123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:53.273577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:53.273998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:53.404363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:53.412788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8906a7b5-1993-4b78-8381-feac5620b5bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153411 Sep 11 06:01:53.413372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2008/3778] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:54.436300 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:54.436908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:54.444276 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:54.444753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:54.445189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:54.445878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:54.446330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:54.446751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:54.573041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:54.581556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab2810a3-c5f1-4c67-9b29-138420ecf724 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149152 Sep 11 06:01:54.582115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1771/3779] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:55.605301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:55.605922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:55.613370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:55.613858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:55.614307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:55.615001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:55.615463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:55.615894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:55.743601 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:55.752183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f3b5152-556f-4211-bb9c-373bc9a8344a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150702 Sep 11 06:01:55.752739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2009/3780] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:56.776117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:56.776724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:56.783851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:56.784357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:56.784796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:56.785486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:56.785942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:56.786369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:56.915964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:56.924464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4fd6f9c0-92ec-46ce-bc23-dab0f9e1b071 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152184 Sep 11 06:01:56.925024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1772/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:57.947259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:57.947873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:57.955002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:57.955482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:57.955923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:57.956652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:57.957103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:57.957524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:58.087862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:58.096713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ced57af6-e777-4f12-b493-58e3fadf71d9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153287 Sep 11 06:01:58.097275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2010/3782] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:01:59.120240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:01:59.120843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:01:59.128212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:59.128689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:59.129128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:59.129811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:01:59.130265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:01:59.130688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:01:59.255807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:01:59.264253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-667e9a92-e539-4aab-896d-50663842f8ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147877 Sep 11 06:01:59.265011 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1773/3783] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:01:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:00.289617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:00.290231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:00.296598 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:00.297077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:00.297505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:00.298189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:00.298639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:00.299060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:00.425405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:00.433521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5425ca78-56d8-4cd8-989c-f21436910794 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147710 Sep 11 06:02:00.434101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2011/3784] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:01.457021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:01.458396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:01.464636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:01.465112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:01.465541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:01.466223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:01.466676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:01.467094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:01.600373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:01.608471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe1d68cb-bc1c-44da-865a-0f462e639d1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155612 Sep 11 06:02:01.609123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1774/3785] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:02.634741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:02.635367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:02.642454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:02.642940 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:02.643386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:02.644375 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:02.644838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:02.645270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:02.647796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:02.778034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:02.787044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fc6f42f-c40f-49f6-b4d1-9619c5ee1b2b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156202 Sep 11 06:02:02.787607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2012/3786] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:03.810486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:03.811105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:03.818180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:03.818668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:03.819144 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:03.819840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:03.820334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:03.820771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:03.947484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:03.956410 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b95999b-6839-472f-8c82-7c92dc2b8817 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149766 Sep 11 06:02:03.956985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1775/3787] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:04.978641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:04.979228 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:04.985801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:04.986281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:04.987008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:04.987696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:04.988176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:04.988921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:05.118990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:05.127900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7d7d918-76cc-4ef5-87b6-39840fde0cde tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153094 Sep 11 06:02:05.128514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2013/3788] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:06.151414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:06.152050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:06.158744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:06.159237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:06.159708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:06.160448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:06.160909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:06.161342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:06.290725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:06.299352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-634695c4-1b82-4a8d-a8fe-be06002be44b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151803 Sep 11 06:02:06.299922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1776/3789] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:07.322700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:07.323314 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:07.329743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:07.330227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:07.330659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:07.331338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:07.331786 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:07.332237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:07.457817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:07.466002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d871833f-b0ff-42fa-9d2c-47904849ac51 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147254 Sep 11 06:02:07.466561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2014/3790] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:08.489628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:08.490372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:08.497750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:08.498244 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:08.498689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:08.499416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:08.500193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:08.500696 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:08.503319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=76 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:08.628086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:08.636295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-24094ae7-f752-4763-9376-93425f2f89a1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150585 Sep 11 06:02:08.636855 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1777/3791] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:09.660145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:09.660665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:09.666975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:09.667452 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:09.667884 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:09.668595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:09.669042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:09.669466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:09.799034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:09.807439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b177e0ed-81fa-440f-8926-eab6e8027c59 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151247 Sep 11 06:02:09.808035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2015/3792] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:10.830992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:10.831603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:10.838081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:10.838566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:10.839006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:10.839694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:10.840182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:10.840611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:10.972192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:10.980891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1259f774-26ac-4a1f-978a-6a6f816c0119 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153835 Sep 11 06:02:10.981461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1778/3793] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:12.005163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:12.005812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:12.012305 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:12.012788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:12.013221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:12.013908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:12.014364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:12.014788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:12.142746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:12.151176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dab43e19-ee02-43d6-ac33-2764e93f5733 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149914 Sep 11 06:02:12.151745 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2016/3794] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:02:13.174943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:13.175558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:13.181838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:13.182326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:13.182767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:13.183461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:13.183918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:13.184378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:13.310675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:13.319600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-022ccf83-b661-43bc-a09c-d9d7ebaa621f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148964 Sep 11 06:02:13.320211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1779/3795] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:02:14.342721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:14.343847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:14.350297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:14.350781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:14.351221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:14.351909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:14.352390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:14.352820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:14.728182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:14.737000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bceae05a-d42a-4c7b-89ba-dd7149e45ef0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.398133 Sep 11 06:02:14.737571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2017/3796] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:15.761259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:15.761770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:15.768998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:15.769746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:15.770192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:15.770891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:15.771352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:15.771784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:15.897910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:15.906692 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d26c2c58-300e-43ef-8550-684b6412173c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148689 Sep 11 06:02:15.907253 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1780/3797] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:16.929876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:16.930494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:16.932942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:16.939383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:16.939868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:16.940344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:16.941031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:16.941482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:16.941905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:17.069723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:17.078096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57ce1a53-63e3-4fa2-bba5-8509c26938a0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152007 Sep 11 06:02:17.078683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2018/3798] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:18.101770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:18.102383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:18.109542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:18.110076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:18.110518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:18.111283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:18.111739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:18.112194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:18.243546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:18.251925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-476696a0-002b-494e-a9fa-028b3a6fb384 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154070 Sep 11 06:02:18.252515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1781/3799] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:19.275820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:19.276492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:19.283168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:19.283705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:19.284187 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:19.284886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:19.285399 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:19.285878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:19.417266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:19.426656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1230d22d-b48d-47b9-a41a-f697bd7f7259 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154682 Sep 11 06:02:19.427224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2019/3800] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:20.450231 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:20.450846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:20.454004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=26 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:20.459326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:20.459816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:20.460294 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:20.460998 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:20.461461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:20.461893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:20.597069 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:20.605181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ccc8360-e93d-45b2-a6ac-1db99ab57cf9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158877 Sep 11 06:02:20.605890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1782/3801] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:21.628895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:21.629509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:21.635907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:21.636422 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:21.636862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:21.637548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:21.638003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:21.638428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:21.765941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:21.774377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2830d957-3cbf-457b-9daf-940c1adacaf5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149322 Sep 11 06:02:21.774952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2020/3802] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:22.798020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:22.798678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:22.805184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:22.805674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:22.806418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:22.806797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:22.807252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:22.807676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:22.940671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:22.948853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96c17e7d-ac5e-4aff-832b-946627bbf3ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155201 Sep 11 06:02:22.949412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1783/3803] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:23.972135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:23.972891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:23.979532 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:23.980048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:23.980497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:23.981200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:23.981658 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:23.982088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:24.140708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:24.149912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d3f227c-2942-4356-b409-81fc172676e6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.181922 Sep 11 06:02:24.150484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2021/3804] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:25.175324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:25.175959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:25.182257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:25.182741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:25.183174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:25.183856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:25.184335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:25.184758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:25.311046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:25.319779 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e920eba-d95b-483d-8ea4-5513ab43bde8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149093 Sep 11 06:02:25.320389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1784/3805] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:26.343286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:26.344094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:26.350566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:26.351047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:26.351481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:26.352196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:26.352651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:26.353076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:26.484615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:26.492668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb0d5a94-592e-4381-9c1f-c87c2291813a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153756 Sep 11 06:02:26.493222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2022/3806] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:27.516257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:27.516867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:27.523700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:27.524226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:27.524671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:27.525357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:27.525815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:27.526250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:27.666326 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:27.675036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1bf06059-9b50-424d-949d-8f66ac067a50 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.163197 Sep 11 06:02:27.675597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1785/3807] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:28.698186 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:28.698806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:28.705561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:28.706046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:28.706482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:28.707168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:28.707622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:28.708075 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:28.836390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:28.845356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af670469-8d20-4c55-ae49-9c60674909cd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151066 Sep 11 06:02:28.845929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2023/3808] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:29.868757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:29.869379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:29.875827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:29.876353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:29.876803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:29.877502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:29.877966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:29.878405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:30.005656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:30.013875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ab41dec-82fb-41a4-ada0-e4e5f81ae440 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149103 Sep 11 06:02:30.014446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1786/3809] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:31.037202 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:31.037876 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:31.044529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:31.045010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:31.045445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:31.046744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:31.047195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:31.047618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:31.179161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:31.188037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1b204fe-61b2-45fb-8d94-12e71bc811a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154667 Sep 11 06:02:31.188600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2024/3810] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:32.211394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:32.212035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:32.218386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:32.218864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:32.219304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:32.219991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:32.220474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:32.220903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:32.346105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:32.354283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee5c3e8a-7964-4dc5-b536-853de060c558 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.146860 Sep 11 06:02:32.354784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1787/3811] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:33.377712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:33.378323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:33.384997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:33.385474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:33.385909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:33.386586 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:33.387036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:33.387454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:33.392157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:33.515189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:33.523496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db58475a-4a2f-481e-8f4f-559ae077f81c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149788 Sep 11 06:02:33.524072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2025/3812] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:34.548269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:34.548872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:34.555173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:34.555654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:34.556115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:34.556803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:34.557257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:34.557681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:34.689079 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:34.697191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8889edc-9b7a-452f-a4e4-37cf25ba8c01 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153734 Sep 11 06:02:34.697748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1788/3813] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:35.722749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:35.723287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:35.729916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:35.730394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:35.730829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:35.731510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:35.731960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:35.732411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:35.861178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:35.869300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1358f8a3-7493-4534-bfd6-86dcd29cfc69 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150576 Sep 11 06:02:35.869868 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2026/3814] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:36.893731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:36.894605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:36.900987 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:36.901472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:36.901951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:36.902646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:36.903105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:36.903534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:37.030468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:37.038584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-018056db-9d1c-460f-8b83-4c6228f4529c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149574 Sep 11 06:02:37.039161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1789/3815] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:38.063157 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:38.063695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:38.070149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:38.070633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:38.071072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:38.071763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:38.072251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:38.072678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:38.202300 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:38.210431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-daae01d0-9111-457b-82af-6355a94fba40 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152031 Sep 11 06:02:38.210987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2027/3816] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:38.659086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:38.659587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:38.665415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:38.665903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:38.666380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:38.667068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:38.667525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:38.667953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:38.672297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=78 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:38.692768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffa82a1c-b636-4a8a-8121-a2ddf139282d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/ips" status: 200 len: 146 microversion: 2.1 time: 0.103512 Sep 11 06:02:38.693318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1790/3817] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:02:38 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/ips => generated 146 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:02:39.233176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:39.234074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:39.240555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:39.241036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:39.241466 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:39.242147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:39.242595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:39.243024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:39.370059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:39.378726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-697af613-d74e-4e19-bd75-de93793b7a20 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149437 Sep 11 06:02:39.379291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2028/3818] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:40.402575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:40.403192 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:40.410461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:40.410951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:40.411395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:40.412118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:40.412582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:40.413041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:40.548227 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:40.556673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0f90ec1-c073-4b76-b431-047cc2917901 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157892 Sep 11 06:02:40.557315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1791/3819] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:41.581409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:41.582101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:41.588439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:41.588922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:41.589356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:41.590037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:41.590484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:41.590907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:41.720652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:41.728666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb32cffe-6fb1-4ca3-b241-41e62a97b30c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151683 Sep 11 06:02:41.729230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2029/3820] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:42.752712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:42.753328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:42.759907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:42.760426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:42.760873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:42.761595 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:42.762049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:42.762486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:42.890312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:42.898617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca8f08be-cc8c-4e29-b91e-11bf85251c6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150015 Sep 11 06:02:42.899168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1792/3821] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:43.924303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:43.924909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:43.931203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:43.931679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:43.932139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:43.932820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:43.933274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:43.933694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:44.062620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:44.070685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e9af8cf-89b8-4ba6-860b-b7cfcf0858d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151071 Sep 11 06:02:44.071241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2030/3822] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:45.094978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:45.095596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:45.102260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:45.102740 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:45.103178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:45.103863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:45.104371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:45.104795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:45.230767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:45.238986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c81e27d-7603-4bb8-8207-302fbcec64bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148420 Sep 11 06:02:45.239540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1793/3823] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:46.262760 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:46.263365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:46.270014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:46.270497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:46.270932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:46.271621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:46.272102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:46.272530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:46.406464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:46.414617 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c35fcf61-c4db-4485-b364-34ff6a179fe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156095 Sep 11 06:02:46.415177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2031/3824] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:47.438750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:47.439357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:47.445785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:47.446269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:47.450757 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:47.451475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:47.452557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:47.453078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:47.582324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:47.590393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-528cfa9b-74f2-4998-8bc3-f5b2f3b85c75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155977 Sep 11 06:02:47.590958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1794/3825] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:48.613623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:48.614237 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:48.616561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:48.621671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:48.622155 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:48.622594 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:48.623284 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:48.624281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:48.624809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:48.758830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:48.767634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fc8ad8e-990e-4028-b651-96c34c8bece3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157843 Sep 11 06:02:48.768226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2032/3826] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:49.790732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:49.791262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:49.798450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:49.798935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:49.799372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:49.800105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:49.800565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:49.800993 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:49.927293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:49.935343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f8897a8-072a-4f03-9858-ccb2013d6d9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148598 Sep 11 06:02:49.935962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1795/3827] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:50.958815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:50.959429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:50.965952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:50.966434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:50.966874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:50.967717 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:50.968287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:50.968721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:51.095952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:51.104225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e042fcb1-af5b-4ad3-8320-da04bde0def0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149341 Sep 11 06:02:51.104783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2033/3828] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:52.126924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:52.127537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:52.129884 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:02:52.135464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:52.135947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:52.136405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:52.137092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:52.137544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:52.138077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:52.267631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:52.276295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-639f76ed-a73f-45ed-8e0f-effd37dce2ab tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153574 Sep 11 06:02:52.276859 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1796/3829] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:53.299690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:53.300331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:53.306720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:53.307205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:53.307643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:53.308364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:53.308820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:53.309248 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:53.440265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:53.448464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecd9318c-4efc-4d72-b39b-ea3d589eea06 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152562 Sep 11 06:02:53.449029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2034/3830] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:54.472815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:54.473421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:54.479887 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:54.480404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:54.480839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:54.481532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:54.481979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:54.482401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:54.612346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:54.620369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79283cfd-f9a0-4bb1-b2b0-3462f15c4f77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151394 Sep 11 06:02:54.620928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1797/3831] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:55.643279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:55.643886 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:55.650487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:55.650967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:55.651400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:55.652106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:55.652559 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:55.653004 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:55.782049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:55.790290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88138b25-6ab3-4973-a9a3-cd4bd5bae371 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150900 Sep 11 06:02:55.790861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2035/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:56.814783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:56.815394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:56.821787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:56.822269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:56.822711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:56.823403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:56.823858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:56.824325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:56.954286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:56.962377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e59506a-57f2-4b15-9595-aaf3fe4534bb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152311 Sep 11 06:02:56.962932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1798/3833] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:57.986972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:57.987651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:57.994703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:57.994703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:57.995091 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:57.995794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:57.996279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:57.996714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:58.128405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:58.136558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b899fe45-3664-49e2-91ae-f4d7e1c9bd43 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154488 Sep 11 06:02:58.137113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2036/3834] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:02:59.159906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:02:59.160570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:02:59.166864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:59.167338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:59.167774 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:59.168495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:02:59.168948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:02:59.169369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:02:59.295459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:02:59.303639 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4cfa315c-3ef8-4f84-9ba2-07e0efd4c059 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147549 Sep 11 06:02:59.304229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1799/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:02:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:00.328325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:00.328929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:00.334955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:00.335432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:00.335869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:00.336581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:00.337034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:00.337454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:00.465550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:00.474615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a232a47d-4753-4df6-a4f2-0d9fb6e61689 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150699 Sep 11 06:03:00.475171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2037/3836] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:01.498146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:01.498755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:01.504837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:01.505316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:01.505754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:01.506430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:01.506881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:01.507302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:01.633973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:01.642066 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2b0babd-112d-46b9-9ef5-d288a8993e0e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148054 Sep 11 06:03:01.642631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1800/3837] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:02.666286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:02.666942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:02.674332 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:02.674818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:02.675257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:02.675952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:02.676443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:02.676872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:02.808287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:02.817662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b296caf7-c2dc-4b4e-a9d0-6756ee4376a5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155319 Sep 11 06:03:02.818222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2038/3838] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:03.840761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:03.841367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:03.848353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:03.848829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:03.849266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:03.849940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:03.850391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:03.850812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:03.982290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:03.991145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f18b274-8e99-4f27-97ae-95fb0dbfce5b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154235 Sep 11 06:03:03.991752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1801/3839] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:05.013980 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:05.015255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:05.022033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:05.022517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:05.022952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:05.023644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:05.024124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:05.024553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:05.028396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:05.157001 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:05.165381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1316b008-5091-4528-af49-b2fba18f27f3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155272 Sep 11 06:03:05.165948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2039/3840] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:06.189115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:06.189719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:06.196085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:06.196565 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:06.197002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:06.197686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:06.198141 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:06.198561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:06.371525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:06.380395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f632f983-3ea7-46ab-97dd-12a48057863b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.196134 Sep 11 06:03:06.380962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1802/3841] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:03:07.403008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:07.403661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:07.410457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:07.410945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:07.411387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:07.412106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:07.412568 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:07.412997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:07.539160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:07.547814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7f0b2fc-7b28-4fea-b810-dfaff83a8c3a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148665 Sep 11 06:03:07.548408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2040/3842] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:08.572147 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:08.572761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:08.579494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:08.579982 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:08.580443 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:08.581132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:08.581588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:08.582012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:08.712472 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:08.714673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:08.722717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5db51956-76ca-4aec-bd7c-280df9dcd105 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154540 Sep 11 06:03:08.723287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1803/3843] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:09.746608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:09.747145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:09.753800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:09.754286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:09.754725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:09.755414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:09.755905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:09.756362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:09.887513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:09.896218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c46bc5c4-0222-4d8a-ab6a-e1d0d8c418ef tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153506 Sep 11 06:03:09.896780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2041/3844] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:10.920315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:10.921799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:10.928057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:10.928541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:10.928976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:10.929680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:10.930114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:10.930545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:11.058535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:11.067542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b35bc060-767b-43f8-b8ff-3ef5e4aab3f8 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151337 Sep 11 06:03:11.068137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1804/3845] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:12.090317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:12.090935 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:12.098008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:12.098506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:12.098946 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:12.099827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:12.100311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:12.100848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:12.228678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:12.237512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80b63be8-49c1-4fa1-9a47-a2f9cbb3d8a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151134 Sep 11 06:03:12.238077 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2042/3846] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:12 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:13.261485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:13.262097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:13.269338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:13.270083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:13.270526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:13.271246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:13.271703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:13.272186 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:13.400743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:13.409427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3c241a0-62cd-4771-8210-a53d83d0ee5f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151831 Sep 11 06:03:13.409989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1805/3847] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:14.432200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:14.432837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:14.435303 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:03:14.435448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 (ip 10.222.0.33) !!! Sep 11 06:03:14.441679 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:14.442165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:14.442605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:14.443301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:14.443756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:14.444213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:14.578841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:14.586979 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9aeb13f-ee83-4aca-bbc8-a78ea4950b6f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.158770 Sep 11 06:03:14.587572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2043/3848] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:15.610218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:15.610832 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:15.613309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:03:15.613459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 (ip 10.222.0.33) !!! Sep 11 06:03:15.619234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:15.619726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:15.620203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:15.620908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:15.621370 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:15.621801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:15.750145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:15.758297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e056c17-b341-43bf-bc4e-2db905a97046 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151973 Sep 11 06:03:15.758858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1806/3849] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:16.782398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:16.783009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:16.789506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:16.789989 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:16.790487 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:16.791182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:16.791636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:16.792080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:16.921390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:16.929599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce2dabf5-56e0-49b0-a244-a69931e0ff88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151248 Sep 11 06:03:16.930171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2044/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:17.953885 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:17.954494 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:17.960881 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:17.961364 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:17.961805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:17.962501 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:17.962963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:17.963392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:18.095203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:18.103451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5269dce8-3f22-4abc-a547-7eff99a2077a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154017 Sep 11 06:03:18.104037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1807/3851] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:19.126311 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:19.126924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:19.129249 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:19.134818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:19.135306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:19.135751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:19.136468 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:19.136927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:19.137354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:19.264941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:19.273376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed6d16fe-3505-45ae-a128-cbd274764660 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151130 Sep 11 06:03:19.273944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2045/3852] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:19 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:20.297156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:20.297761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:20.304383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:20.304862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:20.305298 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:20.305979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:20.306434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:20.306854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:20.432834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:20.441542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22df460d-9a6a-41a2-b201-7e5633a12fdb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148309 Sep 11 06:03:20.442109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1808/3853] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:21.464494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:21.465110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:21.472585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:21.473074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:21.473518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:21.474214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:21.474672 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:21.475107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:21.606283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:21.614621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fdf56702-5b12-4636-b245-5caa7d2be6c2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154055 Sep 11 06:03:21.615190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2046/3854] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:22.638273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:22.639508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:22.642168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=26 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:22.647803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:22.648316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:22.648752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:22.649438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:22.649889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:22.650312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:22.780693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:22.789067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6569c89-f2ef-4cdb-a086-3fa861719f6c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154677 Sep 11 06:03:22.789631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1809/3855] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:23.814012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:23.814629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:23.826060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:23.826567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:23.827608 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:23.828910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:23.829384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:23.829890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:23.977893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:23.986485 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4782da4a-432e-4e6a-bcd6-cd48b9ca8b68 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.177742 Sep 11 06:03:23.987067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2047/3856] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:25.010235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:25.010861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:25.018030 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:25.018508 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:25.018948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:25.019920 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:25.020401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:25.020823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:25.150348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:25.158592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60484ba6-8972-45e2-82e4-d5cb70ccc9af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152283 Sep 11 06:03:25.159148 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1810/3857] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:26.182751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:26.183373 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:26.189955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:26.190445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:26.190895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:26.191589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:26.192085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:26.192538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:26.322407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:26.331312 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-963a1339-81b4-4749-a532-c74f848bd4c9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152490 Sep 11 06:03:26.331913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2048/3858] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:26 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:27.354374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:27.355016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:27.362009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:27.362487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:27.362924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:27.363617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:27.364096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:27.364526 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:27.492551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:27.501357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67fce273-efaa-4387-9e91-ae5d5ad02beb tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150869 Sep 11 06:03:27.501923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1811/3859] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:28.525446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:28.526059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:28.532620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:28.533107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:28.533543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:28.534222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:28.534674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:28.535095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:28.661901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:28.675144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6ab179c-620b-4a93-bcea-966fadb9dba1 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153464 Sep 11 06:03:28.675758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2049/3860] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:29.699262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:29.699796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:29.706745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:29.707232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:29.707668 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:29.708386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:29.708836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:29.709255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:29.839181 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:29.847635 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-daf96fcb-8fbd-4308-8e20-1d7005e9f588 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152324 Sep 11 06:03:29.848230 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1812/3861] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:30.871281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:30.871932 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:30.878521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:30.879013 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:30.879457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:30.880191 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:30.880654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:30.881087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:31.009671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:31.018584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0ab9d5a-74fe-42ed-b4c6-2aebecd25976 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151266 Sep 11 06:03:31.019151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2050/3862] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:32.042496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:32.043145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:32.050237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:32.050717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:32.051155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:32.051842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:32.052330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:32.052758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:32.180468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:32.188583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7caa4aac-a499-4795-a003-612889ff08a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149965 Sep 11 06:03:32.189140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1813/3863] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:33.211000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:33.211622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:33.218069 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:33.218555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:33.218999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:33.219692 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:33.220188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:33.220619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:33.354638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:33.363695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-252bb52e-2e7a-4f27-a538-9517873054d5 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156605 Sep 11 06:03:33.364297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2051/3864] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:33 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:34.387489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:34.388129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:34.394911 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:34.395403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:34.395851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:34.396582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:34.397047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:34.397549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:34.524812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:34.533513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7550dd14-3724-4453-be63-6b03692df594 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149940 Sep 11 06:03:34.534081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1814/3865] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:35.557245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:35.557860 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:35.564637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:35.565119 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:35.565667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:35.566360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:35.566820 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:35.567246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:35.569799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:35.694562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:35.703215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-053162d6-a32e-40d9-aefc-aa04632f95e9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149840 Sep 11 06:03:35.703771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2052/3866] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:36.726120 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:36.726725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:36.733352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:36.733842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:36.734287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:36.734988 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:36.735442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:36.735870 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:36.868471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:36.877140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9932873-12bf-4834-849c-d72ed0bc2503 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154884 Sep 11 06:03:36.877702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1815/3867] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:37.901234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:37.901850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:37.908919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:37.909404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:37.909841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:37.910563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:37.911021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:37.911448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:38.042841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:38.051690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b567ec2f-1700-4533-bac9-41efb87bafe3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154297 Sep 11 06:03:38.052285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2053/3868] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:39.075026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:39.075642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:39.082404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:39.082890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:39.083329 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:39.084038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:39.084500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:39.084929 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:39.220248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:39.228468 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75d94971-110a-499d-a720-f43c339106bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.157239 Sep 11 06:03:39.229040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1816/3869] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:39 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:40.252232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:40.252849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:40.259497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:40.259974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:40.260434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:40.261461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:40.261918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:40.262339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:40.390028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:40.398443 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72203c74-86b8-40f9-b923-1860cb7b58bd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150540 Sep 11 06:03:40.399000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2054/3870] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:41.423042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:41.423552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:41.429901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:41.430380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:41.430815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:41.431500 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:41.431948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:41.432397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:41.436967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:41.562935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:41.571145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59bbf276-f179-4f88-93d5-1293c2fe1bce tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152666 Sep 11 06:03:41.571720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1817/3871] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:42.595068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:42.595676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:42.602068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:42.602544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:42.602974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:42.603678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:42.604220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:42.604644 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:42.741587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:42.749897 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a210c770-ecc8-4646-9a6a-0bbfd6948282 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159528 Sep 11 06:03:42.750464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2055/3872] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:43.773333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:43.773864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:43.780891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:43.781376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:43.781817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:43.782510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:43.782966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:43.783396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:43.911246 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:43.919359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b94c36c-76da-4e9b-9b3f-983cef9beb8d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150233 Sep 11 06:03:43.920026 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1818/3873] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:44.942661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:44.943283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:44.949685 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:44.950165 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:44.950599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:44.952161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:44.952732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:44.953159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:45.078556 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:45.086801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6f7255f-b0cf-400d-82c7-ac9e3707b12b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148042 Sep 11 06:03:45.087370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2056/3874] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:46.109660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:46.110262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:46.117589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:46.118071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:46.118506 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:46.119193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:46.119643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:46.120098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:46.253866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:46.261905 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a776fb48-8977-4e70-a5dc-92f4939ded19 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156175 Sep 11 06:03:46.262481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1819/3875] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:46 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:47.286560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:47.287203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:47.293629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:47.294110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:47.294545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:47.295890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:47.296372 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:47.296798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:47.425350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:47.433554 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-119f4efd-19e7-4007-8d2a-5df92088608d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150875 Sep 11 06:03:47.434125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2057/3876] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:03:48.456624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:48.457235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:48.463642 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:48.464162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:48.464611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:48.465308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:48.465769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:48.466201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:48.592430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:48.600559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da4265d3-95e2-4a46-a7a9-d5299ae886a7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147814 Sep 11 06:03:48.601121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1820/3877] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:49.625457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:49.626072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:49.628910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:49.634194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:49.634722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:49.635110 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:49.635790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:49.636265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:49.636686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:49.767970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:49.776350 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-497e3ebb-3971-4b33-af77-71915aab9790 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155247 Sep 11 06:03:49.776911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2058/3878] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:50.799730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:50.800967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:50.807577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:50.808095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:50.808543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:50.809248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:50.809736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:50.810748 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:50.939901 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:50.948127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ff6185f-6dfd-4ea9-9757-2057cf13cae0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152314 Sep 11 06:03:50.948693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1821/3879] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:51.972473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:51.973088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:51.979577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:51.980092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:51.980531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:51.981222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:51.981684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:51.982158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:52.110974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:52.119183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5312af36-2f3c-4768-a966-eb80caa931b9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150634 Sep 11 06:03:52.119741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2059/3880] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:53.143161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:53.143772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:53.146333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=26 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:03:53.151814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:53.152323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:53.152766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:53.153487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:53.154496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:53.154924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:53.283819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:53.291962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1065a80-d47d-436d-bcc9-e1a5058ceb77 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152716 Sep 11 06:03:53.292549 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1822/3881] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:53 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:54.316044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:54.316680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:54.323046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:54.323528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:54.323964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:54.324669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:54.325147 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:54.325588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:54.455400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:54.463609 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a9cc00b-355b-40cc-880d-85570a15151e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151448 Sep 11 06:03:54.464192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2060/3882] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:55.487557 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:55.488198 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:55.494558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:55.495035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:55.495469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:55.496176 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:55.496631 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:55.497054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:55.623517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:55.631629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-475b97db-73ab-44ee-9415-ab2843d023e0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147967 Sep 11 06:03:55.632330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1823/3883] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:56.655289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:56.655910 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:56.662416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:56.662900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:56.663339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:56.664044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:56.664504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:56.664928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:56.792622 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:56.800467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e706a040-c7b8-4305-b075-aa8150960e96 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149686 Sep 11 06:03:56.801037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2061/3884] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:57.824701 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:57.825338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:57.832619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:57.833097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:57.833531 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:57.834225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:57.834676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:57.835097 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:57.966234 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:57.974376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a51cf7c-99aa-43df-a08a-c257ffc95cbd tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153597 Sep 11 06:03:57.974942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1824/3885] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:03:58.999134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:03:58.999655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:03:59.005766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:59.006247 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:59.006687 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:59.007377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:03:59.007863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:03:59.008317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:03:59.134536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:03:59.142801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84cf21d0-e739-4243-bd15-25b67439112d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148241 Sep 11 06:03:59.143348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2062/3886] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:03:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:00.166957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:00.167563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:00.170132 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:04:00.170261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 (ip 10.222.0.33) !!! Sep 11 06:04:00.176184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:00.176664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:00.177107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:00.177795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:00.178255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:00.178679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:00.304395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:00.313248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fba1c756-1daf-4c11-9b1a-57d559711f1f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150278 Sep 11 06:04:00.313811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1825/3887] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:00 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:01.336279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:01.336890 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:01.343894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:01.344402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:01.344837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:01.345519 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:01.345971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:01.346394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:01.476824 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:01.485051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac5ad09d-44aa-495b-b626-5c16c9eb9e4d tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152703 Sep 11 06:04:01.485610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2063/3888] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:02.508050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:02.508657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:02.515867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:02.516379 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:02.516819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:02.517507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:02.517963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:02.518389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:02.644515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:02.652923 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b814c04d-bfba-4f89-98eb-789e6591dafa tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148828 Sep 11 06:04:02.653493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1826/3889] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:03.676515 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:03.677152 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:03.683543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:03.684048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:03.684486 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:03.685713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:03.686281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:03.686708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:03.816207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:03.824359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efa2007a-daba-4a30-b977-51187e84ad66 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151662 Sep 11 06:04:03.824921 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2064/3890] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:04.847455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:04.848103 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:04.854456 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:04.854940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:04.855388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:04.856112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:04.856571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:04.857601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:04.991293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:05.000196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6cc171cd-67aa-4c63-80fc-c72eda635124 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156598 Sep 11 06:04:05.000760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1827/3891] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:06.022853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:06.023496 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:06.030722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:06.031207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:06.031646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:06.032379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:06.032836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:06.033264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:06.037339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:06.165039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:06.174321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4f96bdc-4038-4640-a782-98069f5cb481 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155548 Sep 11 06:04:06.174900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2065/3892] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:06 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:07.197374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:07.197989 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:07.204572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:07.205052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:07.205491 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:07.206178 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:07.206637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:07.207065 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:07.332963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:07.341718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8406e49-bbd9-4ba9-95cb-da04d8f026f9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147547 Sep 11 06:04:07.342285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1828/3893] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:08.365613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:08.366253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:08.372952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:08.373436 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:08.373870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:08.374560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:08.375058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:08.375459 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:08.501985 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:08.510115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9697491-9d8e-4376-a47e-6e3afdaf0d2c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148384 Sep 11 06:04:08.510673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2066/3894] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:08 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:09.534766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:09.535408 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:09.541782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:09.542266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:09.542712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:09.543402 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:09.543858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:09.545242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:09.674910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:09.683476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-43ec3aba-b150-4b80-9813-39e454bf0885 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152558 Sep 11 06:04:09.684076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1829/3895] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:09 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:10.707176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:10.707794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:10.714204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:10.714694 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:10.715138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:10.715833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:10.716896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:10.717391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:10.849207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:10.858192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd1882ff-6593-4252-9527-417efbb58ecc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154960 Sep 11 06:04:10.858757 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2067/3896] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:10 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:11.881783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:11.882386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:11.889204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:11.889679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:11.890114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:11.890792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:11.891245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:11.891666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:11.895776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=78 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:12.018226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:12.026564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-002118db-f188-435a-a1b8-ec617df50222 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148634 Sep 11 06:04:12.027121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1830/3897] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:11 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:13.050666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:13.051290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:13.062655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:13.064220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:13.064669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:13.065404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:13.065862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:13.066292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:13.198103 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:13.207003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be9bff4d-c369-4a2d-92d9-24cbfc547579 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.160188 Sep 11 06:04:13.207561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2068/3898] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:13 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:14.229893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:14.230525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:14.237074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:14.237548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:14.237981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:14.238659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:14.239114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:14.239533 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:14.372721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:14.380933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d8c77c4-4a24-480b-8f23-e6373e068cd3 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154905 Sep 11 06:04:14.381499 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1831/3899] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:14 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:15.403808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:15.404497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:15.411084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:15.411564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:15.412016 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:15.412699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:15.413149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:15.413571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:15.540805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:15.549137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8624ced-2b71-4b1b-b7e2-69bde67d96f7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149412 Sep 11 06:04:15.549705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2069/3900] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:15 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:16.572830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:16.573440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:16.579789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:16.580304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:16.580742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:16.581426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:16.581880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:16.582301 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:16.708136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:16.717229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8540653b-32f5-4f93-aaa7-0f8c92d02aaf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148167 Sep 11 06:04:16.717807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1832/3901] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:16 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:17.740776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:17.741316 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:17.748269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:17.748751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:17.749184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:17.749872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:17.750325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:17.750749 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:17.884943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:17.893146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3d71225-9f3a-4754-867e-085a1fa269bf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156358 Sep 11 06:04:17.893708 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2070/3902] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:17 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:18.915666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:18.916303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:18.922936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:18.923421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:18.923862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:18.924580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:18.925037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:18.925464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:19.057262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:19.067025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3408f0a3-2212-49a6-b91c-ae4adbcae3d6 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155122 Sep 11 06:04:19.067806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1833/3903] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:18 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:20.090458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:20.091833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:20.094009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:20.099379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:20.099863 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:20.100333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:20.101022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:20.101475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:20.101898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:20.228371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:20.236642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fabec893-b1bb-49ab-acf8-309682870a1b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150029 Sep 11 06:04:20.237210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2071/3904] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:20 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:21.259938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:21.260579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:21.266976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:21.267457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:21.267899 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:21.268675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:21.269131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:21.269558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:21.396930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:21.405809 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-84002684-a089-4e9d-bcf3-0b398f160e79 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149968 Sep 11 06:04:21.406389 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1834/3905] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:21 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:22.429642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:22.430258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:22.436847 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:22.437339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:22.437782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:22.438479 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:22.438938 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:22.439370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:22.569722 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:22.578006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cf2dc56-f58c-4bb5-b185-936586df251c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152194 Sep 11 06:04:22.578567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2072/3906] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:22 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:23.600273 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:23.600882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:23.603217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=26 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:23.609380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:23.609867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:23.610338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:23.611034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:23.611525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:23.611951 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:23.738783 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:23.746794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed2987d4-c939-4557-95d7-a8f60cfa7aa7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150385 Sep 11 06:04:23.747347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1835/3907] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:23 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:24.770942 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:24.771552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:24.778137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:24.778618 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:24.779050 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:24.779903 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:24.780403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:24.780826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:24.908451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:24.916723 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-259ed9b5-35e5-41b0-ae26-6f911f9661e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149873 Sep 11 06:04:24.917285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2073/3908] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:24 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:25.941220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:25.941871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:25.948659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:25.949052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:25.949495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:25.950197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:25.950657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:25.951091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:26.102345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:26.111390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0444840c-9912-40bc-a449-50495f6766ac tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.174325 Sep 11 06:04:26.111963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1836/3909] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:25 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:27.140767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:27.141389 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:27.148107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:27.148596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:27.149036 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:27.149731 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:27.150188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:27.150616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:27.278639 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:27.286853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21e5b25e-43e6-490c-bd9c-7163f6c4a307 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150709 Sep 11 06:04:27.287416 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2074/3910] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:27 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:28.309367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:28.309979 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:28.316492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:28.316978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:28.317418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:28.318122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:28.318570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:28.318999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:28.448560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:28.457384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e60a3272-6d66-4c8f-a68e-b2fd1ed584c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151851 Sep 11 06:04:28.457949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1837/3911] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:28 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:29.480317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:29.480926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:29.487566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:29.488089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:29.488543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:29.489212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:29.489664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:29.490087 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:29.620518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:29.628805 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c20d83a-dec2-471e-b5dd-436c15991b24 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152576 Sep 11 06:04:29.629374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2075/3912] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:29 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:30.652189 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:30.652801 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:30.659102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:30.659586 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:30.660040 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:30.660731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:30.661187 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:30.661609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:30.789952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:30.798168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78d2a7df-0e44-4f5f-b0cb-1c14d952d0d4 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150039 Sep 11 06:04:30.798733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1838/3913] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:30 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:31.822159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:31.822777 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:31.829272 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:31.829755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:31.830200 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:31.830898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:31.831358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:31.831789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:31.959166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:31.967382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2eaf8a8f-f6bd-4915-b33a-6fe008b61a88 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149217 Sep 11 06:04:31.967952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2076/3914] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:31 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:32.990378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:32.991010 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:32.997386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:32.997873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:32.998349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:32.999723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:33.000407 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:33.000842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:33.133067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:33.142226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5301ae7a-400c-41d6-87fd-de32471daa37 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155748 Sep 11 06:04:33.142796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1839/3915] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:32 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:34.165636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:34.166246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:34.172936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:34.173419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:34.173854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:34.174539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:34.174990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:34.175418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:34.306442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:34.315192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80ff3eaf-9702-4da9-a5a9-5f3ea9e50b00 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153465 Sep 11 06:04:34.315755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2077/3916] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:34 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:35.338320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:35.338939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:35.345995 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:35.346482 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:35.346922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:35.347611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:35.348096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:35.348525 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:35.473730 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:35.481952 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9af93206-340a-49d2-b6f7-c81cbdcd79af tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147495 Sep 11 06:04:35.482518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1840/3917] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:35 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:36.507109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:36.507628 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:36.514064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:36.515177 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:36.515789 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:36.516514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:36.516968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:36.517391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:36.519877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:36.645339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:36.653569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a9576b6-71ab-4881-b0a7-6a83a5223a93 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150387 Sep 11 06:04:36.654133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2078/3918] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:36 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:37.677232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:37.677846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:37.685352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:37.685843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:37.686418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:37.687272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:37.687738 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:37.688214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:37.820588 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:37.829351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1565ced7-d503-479d-875b-0cb752367137 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155974 Sep 11 06:04:37.829919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1841/3919] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:37 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:38.853283 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:38.853891 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:38.860807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:38.861293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:38.861751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:38.862461 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:38.862914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:38.863340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:38.997195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:39.005962 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3baa7111-8efb-48ae-8b8b-ae90966fc58c tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.156595 Sep 11 06:04:39.006526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2079/3920] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:38 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:40.031388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:40.032015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:40.038387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:40.038867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:40.039302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:40.039985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:40.040459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:40.040914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:40.166784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:40.175465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56a7a6bb-f29c-4e69-9257-b6a3c3216c90 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148622 Sep 11 06:04:40.176041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1842/3921] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:40 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:41.198664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:41.199282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:41.205810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:41.206289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:41.206725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:41.207411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:41.207871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:41.208331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:41.333821 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:41.341905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d228dab-68f9-4168-a0fb-38372b7bf335 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147168 Sep 11 06:04:41.343053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2080/3922] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:41 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:42.365562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:42.366093 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:42.372401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:42.372877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:42.373313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:42.374322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:42.374793 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:42.375217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:42.379017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=78 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:42.504160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:42.512304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-528fd1bb-bf10-4607-81b4-da36664a69e7 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150635 Sep 11 06:04:42.512869 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1843/3923] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:42 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:43.536038 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:43.536711 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:43.543259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:43.543748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:43.544226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:43.545005 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:43.545668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:43.546334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:43.671858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:43.680101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-078b4e04-84d3-43a6-80d9-b4ac81656836 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147934 Sep 11 06:04:43.680668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2081/3924] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:43 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:44.704943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:44.705550 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:44.711883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:44.712393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:44.712829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:44.713510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:44.713966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:44.714386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:44.843914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:44.852131 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8540ca78-5881-4b21-a1bb-ddcc616f99a2 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152004 Sep 11 06:04:44.852703 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1844/3925] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:44 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:45.929218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:45.929877 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:45.936534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:45.937014 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:45.937450 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:45.938135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:45.938587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:45.939007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:46.069478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:46.078227 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12d82681-d284-4b95-9797-934bb20c6273 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152857 Sep 11 06:04:46.078800 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2082/3926] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:45 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:47.102071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:47.102697 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:47.109252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:47.109731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:47.110169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:47.110858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:47.111312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:47.111735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:47.241548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:47.249794 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a2cfec1-d9f6-4358-b92a-7a475db40e47 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151692 Sep 11 06:04:47.250360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1845/3927] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:47 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:48.272123 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:48.272739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:48.279235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:48.279752 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:48.280287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:48.280978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:48.281442 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:48.281866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:48.413012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:48.421983 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6e3bd66-b352-4ec7-a4c8-2ea5d6148c56 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153975 Sep 11 06:04:48.422549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2083/3928] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:48 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:49.445688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:49.446303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:49.452800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:49.453292 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:49.453736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:49.454436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:49.454897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:49.455327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:49.580800 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:49.588853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07d8007d-8a5c-4539-993f-9bc744f48a27 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147054 Sep 11 06:04:49.589424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1846/3929] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:49 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:50.612619 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:50.613233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:50.615510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:50.620923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:50.621410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:50.621849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:50.622541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:50.622997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:50.623427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:50.753189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:50.761306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d05b470-42c3-413b-bdfb-79585f2efb04 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152621 Sep 11 06:04:50.761867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2084/3930] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:50 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:51.786378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:51.786909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:51.794672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:51.795159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:51.795597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:51.796320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:51.797705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:51.798248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:51.924815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:51.933112 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d8e68aa-e78b-4413-9f34-720f598f3a74 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.150680 Sep 11 06:04:51.933684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1847/3931] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:51 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:52.957083 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:52.957726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:52.964328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:52.964818 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:52.965291 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:52.965987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:52.966446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:52.966872 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:53.098235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:53.106366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b02bd2b1-7b00-40ea-a162-882defe614bc tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.153828 Sep 11 06:04:53.106923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2085/3932] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:52 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:54.130438 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:54.131062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:54.133383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=26 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:04:54.138965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:54.139461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:54.139935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:54.141460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:54.141926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:54.142359 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:54.273355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:54.282067 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2dbced7-c46d-44ba-b33d-033789223544 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155486 Sep 11 06:04:54.282633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1848/3933] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:54 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:55.305270 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:55.305896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:55.313229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:55.313720 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:55.314162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:55.314858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:55.315319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:55.315751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:55.441827 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:55.449967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c461b9d-4843-4486-809f-c33c04216c58 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148910 Sep 11 06:04:55.450533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2086/3934] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:55 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:56.473763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:56.474371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:56.481084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:56.481561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:56.481999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:56.482831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:56.483288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:56.483712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:56.620610 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:56.628981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99d0d885-a1bf-46de-8cd8-cbd5e5afa551 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.159132 Sep 11 06:04:56.629552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1849/3935] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:56 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:57.652488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:57.653101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:57.660096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:57.660584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:57.661023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:57.661712 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:57.662169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:57.662597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:57.792393 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:57.801521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-810d2413-2b57-477c-adc1-1b8cfe874099 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152912 Sep 11 06:04:57.802096 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2087/3936] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:57 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:04:58.824552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:04:58.825160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:04:58.832428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:58.832909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:58.833347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:58.834034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:04:58.834487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:04:58.834909 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:04:58.966817 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:04:58.975486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-66d2c4af-937f-4ea3-9299-4563f17efd21 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.154775 Sep 11 06:04:58.976061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1850/3937] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:58 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:00.001259 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:00.001871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:00.008106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:00.008589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:00.009023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:00.009709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:00.010156 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:00.010579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:00.136659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:00.145939 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd94b123-ef9e-409d-a065-bd59fd6da1c0 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.149160 Sep 11 06:05:00.146499 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2088/3938] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:04:59 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:01.169236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:01.169847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:01.171903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:05:01.172070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:05:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 (ip 10.222.0.33) !!! Sep 11 06:05:01.177829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:01.178311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:01.178752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:01.179450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:01.179907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:01.180374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:01.305275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:01.313860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb453013-65c9-44dd-a28d-e6ce04859598 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.148659 Sep 11 06:05:01.314424 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1851/3939] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:01 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:02.336878 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:02.337488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:02.345003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:02.345482 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:02.345918 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:02.346600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:02.347052 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:02.347475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:02.479604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:02.488313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6074fba8-ece9-444a-ba62-6cf1aded68be tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.155245 Sep 11 06:05:02.488874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2089/3940] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:02 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:03.510892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:03.511537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:03.517925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:03.518404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:03.518840 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:03.519528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:03.519985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:03.520699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:03.646875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:03.654966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09a8f647-7feb-4712-8b64-49ee27cd32ed tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.147954 Sep 11 06:05:03.655536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1852/3941] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:03 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:04.678526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:04.679142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:04.685587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:04.686070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:04.686512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:04.687911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:04.688458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:04.688889 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:04.817412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:04.825615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09f71b22-a9e6-4aca-ab3b-daff02f5860f tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.151019 Sep 11 06:05:04.826180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2090/3942] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:04 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:05.849404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:05.850022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:05.856400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:05.856889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:05.857332 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:05.858024 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:05.858513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:05.858944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:05.990053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:05.998235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5932fdbb-2fde-4160-9b00-f5a211e8df0b tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.152762 Sep 11 06:05:05.998844 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1853/3943] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:05 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:07.022469 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:07.023280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 45817200-bc9c-4b2e-9a6d-73fb57c45699] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:05:07.029705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:07.030190 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:07.031431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:07.032419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:07.032927 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:07.033356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:07.037401 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:05:07.171678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:05:07.180022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8cb76a7-d827-4641-903e-23154f61b1a9 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699" status: 200 len: 1734 microversion: 2.1 time: 0.161855 Sep 11 06:05:07.180603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2091/3944] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:05:07 2022] GET /compute/v2.1/servers/45817200-bc9c-4b2e-9a6d-73fb57c45699 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:05:07.203199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e9cd4f7-1e8a-4b16-bb65-1bb3168f8fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '.version_select at 0x7f2c3ef7d670>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:05:07.225171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e9cd4f7-1e8a-4b16-bb65-1bb3168f8fbf tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-318681437" status: 202 len: 0 microversion: 2.1 time: 0.026170 Sep 11 06:05:07.225735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1854/3945] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 11 06:05:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-318681437 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:05:08.103508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:05:08.113741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:05:08.114209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:05:08.114635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:05:08.126490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] Creating event network-changed:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 06:05:08.132057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-23710ce8-52d6-4e20-883e-4ef4396415c1 req-e2044442-907a-46e9-a0cd-73884ee044ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032135 Sep 11 06:05:08.132652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2092/3946] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:48.042263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=65 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:06:48.044700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:06:48.053391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82c2eca-dca9-46c4-904a-fea0474a028e"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:48.057566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:48.072371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.073759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.074518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.075940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.077129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.077744 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.092870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=17 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:06:48.094067 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=7 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:06:48.095529 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:06:48.095773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 06:06:48.097651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:06:48.097870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments (ip 10.222.0.33) !!! Sep 11 06:06:48.112605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51807b2d-8051-48a3-8ed9-318e52769dec"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:48.115547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:48.134108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.134715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.137301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.138124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.138714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.139828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.777477 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b41f5fe9-f8d0-4735-a809-6a04d297666a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742054 Sep 11 06:06:48.778262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1855/3947] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 06:06:48 2022] POST /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:48.785265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:48.786195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:48.812485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.813452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.815511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.816890 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:48.817628 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:48.818411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:48.850435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73bbf324-c216-4ba2-b25b-63592eacba62 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759666 Sep 11 06:06:48.860587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2093/3948] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 06:06:48 2022] POST /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:48.897169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lazy-loading 'flavor' on Instance uuid aa924fd1-fde8-4e57-a0d3-fc002d20231a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:06:49.131977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4591d3a3-2ace-43c9-8a28-8209f22b50f1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/action" status: 202 len: 0 microversion: 2.20 time: 0.351939 Sep 11 06:06:49.135922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1856/3949] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 11 06:06:48 2022] POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 06:06:49.143101 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:49.144730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:49.152381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:49.152988 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:49.153505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:49.154396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:49.154853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:49.155282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:49.314220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:49.322879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:49.325763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:49.326991 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1229be3-1c76-496d-939a-87b8d14a44da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.189609 Sep 11 06:06:49.327836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2094/3950] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:49 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:50.354436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:50.355138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:50.362739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:50.363170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:50.363611 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:50.364341 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:50.364803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:50.365232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:50.563357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:50.572950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:50.575143 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:50.577415 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-84a26c3b-71f7-4ede-8112-3e10da137a63 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.227763 Sep 11 06:06:50.578053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1857/3951] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:50 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:51.603677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:51.604366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:51.611346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:51.612327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:51.612778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:51.613488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:51.613951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:51.614380 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:51.887366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:51.919555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:51.925602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:51.933020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2568c559-f95e-4a03-89bd-2dddc8aa8e09 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.333281 Sep 11 06:06:51.935453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2095/3952] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:51 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:51.967601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42e41e9-5297-4be5-a77d-6558fdb3b01f", "name": "network-vif-deleted", "tag": "de1a56c3-9f13-4434-afbc-573439a20fe3"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:51.982966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:51.983827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:51.988210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:52.014150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] Creating event network-vif-deleted:de1a56c3-9f13-4434-afbc-573439a20fe3 for instance c42e41e9-5297-4be5-a77d-6558fdb3b01f on hv-cinder-85692 Sep 11 06:06:52.058604 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-26fc68be-bb03-4e84-ae35-6f37d970fbda req-18864690-459a-4da3-97c0-a5f8a3615d7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289342 Sep 11 06:06:52.059556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1858/3953] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:52.914106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e812967c-7475-468f-a1c8-433fef2f929c", "name": "network-vif-deleted", "tag": "d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:52.928366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:52.928856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:52.929293 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:52.943160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] Creating event network-vif-deleted:d72e1a71-dbc9-4c3f-a306-ac2805d0c7bb for instance e812967c-7475-468f-a1c8-433fef2f929c on hv-cinder-85692 Sep 11 06:06:52.949423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4e18ede6-b5b8-4945-9ee9-3bfca450f8d3 req-344cc46d-a52d-4688-9ebe-b3e1251b7ced service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100915 Sep 11 06:06:52.950051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2096/3954] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:52.963017 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:52.963807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:52.971082 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:52.971758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:52.972242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:52.972944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:52.973404 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:52.973825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:53.109369 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:53.118711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:53.122339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:53.123542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a33d3911-8c55-4f25-833a-861be2a13699 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.164891 Sep 11 06:06:53.124453 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1859/3955] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:52 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:54.152388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:54.152388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:54.163051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:54.163553 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:54.164148 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:54.164764 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:54.165230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:54.165657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:54.350695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:54.359926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:54.362192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:54.363763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56e8d5b6-8555-4645-bee6-8dfe11467dc2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.217819 Sep 11 06:06:54.364849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2097/3956] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:54 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:54.977719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45817200-bc9c-4b2e-9a6d-73fb57c45699", "name": "network-vif-deleted", "tag": "9496018a-e586-49a0-bbd2-47c1497e4414"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:54.988607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:54.989124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:54.989589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:55.001053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] Creating event network-vif-deleted:9496018a-e586-49a0-bbd2-47c1497e4414 for instance 45817200-bc9c-4b2e-9a6d-73fb57c45699 on hv-cinder-85692 Sep 11 06:06:55.008233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-7cce1505-869a-4dfd-807d-2693d15d67a2 req-311925f3-3976-4d79-af09-bbf72a839a6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034219 Sep 11 06:06:55.009196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1860/3957] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:55.390528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:55.391285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:55.408774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:55.408774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:55.408774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:55.408774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:55.409388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:55.409388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:55.649216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:55.666735 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:55.674651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:55.675855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5969194-5a9d-4b95-8815-960260d6ff5b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.289195 Sep 11 06:06:55.677597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2098/3958] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:55 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:56.703405 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:56.704139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:56.712229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:56.712715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:56.713151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:56.713847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:56.714304 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:56.714732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:56.858486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:56.867571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:56.869200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:56.870529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e7e658e-a01a-473f-9c46-e70d337ed444 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.171585 Sep 11 06:06:56.871094 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1861/3959] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:56 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:57.025115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811bc271-657e-410b-9fb8-dfc4c0ca1880", "name": "network-vif-deleted", "tag": "e8803d5d-3a7a-4ad5-9375-30807fb3f871"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:06:57.035280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:57.035762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:57.036222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:57.047775 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] Creating event network-vif-deleted:e8803d5d-3a7a-4ad5-9375-30807fb3f871 for instance 811bc271-657e-410b-9fb8-dfc4c0ca1880 on hv-cinder-85692 Sep 11 06:06:57.053908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e6950b23-194c-49ad-87ea-3fb07d463219 req-05253d9a-8247-435a-84bd-9ca28885c9e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Sep 11 06:06:57.054848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2099/3960] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:06:57.898238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:57.898918 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:57.905574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:57.906068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:57.906507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:57.907204 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:57.907658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:57.908690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:58.047054 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:58.060194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:58.061732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:58.062902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0425ff8-bc8f-4dd2-8088-e75c0ac43080 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.168939 Sep 11 06:06:58.063645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1862/3961] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:57 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:06:59.089693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:06:59.090410 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:06:59.096894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:59.097632 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:59.098078 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:59.098782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:06:59.099245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:06:59.099676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:06:59.229273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:59.237629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:59.239079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:06:59.240323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd6b0f94-bad6-4e21-b6b4-5c71df0c5f4d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.155659 Sep 11 06:06:59.241082 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2100/3962] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:06:59 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:00.265892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:00.266529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:00.273211 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:00.273686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:00.274122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:00.274807 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:00.275256 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:00.275674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:00.413938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:00.422223 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:00.423669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:00.425803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c1ecfefe-2751-4b8c-9f8d-85c102f3392b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.163852 Sep 11 06:07:00.426437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1863/3963] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:00 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:01.451387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:01.452025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:01.459348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:01.459829 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:01.460418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:01.461108 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:01.461569 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:01.462042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:01.604652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:01.613359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:01.614798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:01.615958 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cab0c9ad-dd4a-44e5-a157-3259a0bcda43 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.168591 Sep 11 06:07:01.616561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2101/3964] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:01 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:01.852579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82c2eca-dca9-46c4-904a-fea0474a028e"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:01.855137 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:01.866222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:01.866222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:01.866222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:01.866222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:01.866593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:01.866593 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:01.946047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: POST /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments HTTP/1.1 Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 74 Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:07:01.947977 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {"volumeAttachment": {"volumeId": "b82c2eca-dca9-46c4-904a-fea0474a028e"}} Sep 11 06:07:01.949582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '076459f2-fb04-482c-a87a-fb95f2bc085e', 'body': {'volumeAttachment': {'volumeId': 'b82c2eca-dca9-46c4-904a-fea0474a028e'}}} Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:01.950397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:01.951733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 400 to user: Invalid volume: volume b82c2eca-dca9-46c4-904a-fea0474a028e is already attached to instances: 076459f2-fb04-482c-a87a-fb95f2bc085e {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-77b65884-0de3-467c-80d8-61f1b8df2b0d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100963 Sep 11 06:07:01.953452 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1864/3965] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 06:07:01 2022] POST /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 06:07:02.017441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:02.018572 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:02.024807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.025301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.025746 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.026449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.026909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.027340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.113817 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'services' on Instance uuid 076459f2-fb04-482c-a87a-fb95f2bc085e {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:02.195185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-859f6608-c1c7-46b6-8d7a-c5031cbc830a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments/b82c2eca-dca9-46c4-904a-fea0474a028e" status: 202 len: 0 microversion: 2.1 time: 0.181394 Sep 11 06:07:02.196397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2102/3966] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 06:07:02 2022] DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments/b82c2eca-dca9-46c4-904a-fea0474a028e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:07:02.210889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:02.213217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:02.226950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.228061 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.228634 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.229656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.230241 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.230908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.274676 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38b8a2a3-28f0-439e-9d2d-ed3690585dbb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073982 Sep 11 06:07:02.276269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1865/3967] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:02 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:02.643132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:02.643906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:02.650447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.650941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.651382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.652115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:02.652579 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:02.653003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:02.790969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:02.799816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:02.801306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:02.802493 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41efb5c5-154b-4222-b13f-35b1c6c19562 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1744 microversion: 2.20 time: 0.164624 Sep 11 06:07:02.803053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2103/3968] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:02 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:03.288680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:03.291016 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:03.297485 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:03.297962 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:03.298401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:03.299724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:03.300331 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:03.300752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:03.338450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7157acf1-6e7a-4566-a45e-58ab12bf0c62 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053748 Sep 11 06:07:03.339013 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1866/3969] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:03 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:03.828700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:03.829306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:03.836741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:03.837225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:03.837662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:03.838357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:03.838806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:03.839224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:03.974714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:03.983721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:03.985516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:03.986982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc07dbd9-e2ca-4752-8a26-8574fd9ee187 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1744 microversion: 2.20 time: 0.161906 Sep 11 06:07:03.987706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2104/3970] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:03 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:04.352809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:04.355445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:04.357110 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "name": "network-vif-plugged", "status": "completed", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:04.363642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:04.364158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:04.364611 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:04.365292 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:04.365901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:04.366483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:04.370153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:04.370935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:04.371474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:04.383086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] Creating event network-vif-plugged:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 06:07:04.388654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-ea42e6e6-03e3-4f2b-b2b1-69a00cf0cd96 req-c059e753-5abc-41e4-9d05-b8fdcb018a09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106340 Sep 11 06:07:04.389338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1867/3971] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:04.402287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63971680-8c5d-4bdc-aad6-aa7b72ed2625 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054840 Sep 11 06:07:04.402854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2105/3972] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:04 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:05.012476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:05.013158 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:05.019933 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:05.020447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:05.021490 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:05.021945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:05.022400 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:05.022827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:05.169432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:05.179162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:05.180725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:05.181973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-381e9e97-c0e9-4531-b026-0db8d1af8015 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1744 microversion: 2.20 time: 0.173861 Sep 11 06:07:05.182805 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1868/3973] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:05 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:05.413933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:05.416182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:05.422578 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:05.423059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:05.423492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:05.424928 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:05.425571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:05.425997 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:05.456382 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3805c630-497e-4ffe-867f-34be0b76b9be tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Sep 11 06:07:05.456960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2106/3974] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:05 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:06.206984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:06.207599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:06.214826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:06.215427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:06.215841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:06.216571 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:06.217021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:06.217441 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:06.359287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:06.367723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:06.369215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:06.370396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2603c2a4-484a-4a87-a80d-2fcaf1c6e262 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1744 microversion: 2.20 time: 0.167587 Sep 11 06:07:06.370949 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1869/3975] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:06 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:06.469241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:06.471816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:06.478887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:06.479388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:06.479831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:06.480767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:06.482215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:06.482662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:06.515808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7eb42735-cd89-4615-9065-b5030bf06faf tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050757 Sep 11 06:07:06.516544 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2107/3976] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:06 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:07.396465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:07.397978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:07.405427 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:07.406188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:07.406893 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:07.408849 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:07.409847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:07.410340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:07.414708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:07.529308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:07.532288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:07.539447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:07.539705 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:07.540183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:07.540885 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:07.541348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:07.541774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:07.580028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:07.585834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc169961-865c-4f14-bf14-b3d9d6137ba8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060576 Sep 11 06:07:07.586713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2108/3977] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:07 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:07.602135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:07.611812 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:07.614847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:07.616071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-deba12a2-051c-499d-a03d-5f398ee71dca tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.224085 Sep 11 06:07:07.620392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1870/3978] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:07 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:08.360976 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:08.363222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:08.373643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.375024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.376223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.379002 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.379665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.380290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.433218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0721c3e2-d2f5-4f08-af43-f149e7b8a525 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076255 Sep 11 06:07:08.434474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2109/3979] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:08 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:08.449395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:08.449902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:08.459064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.459795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.460406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.461270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.461878 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.462469 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.504357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-852a6d0d-1767-4ec9-ac61-cdb9d6f8c4f8 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec" status: 200 len: 194 microversion: 2.1 time: 0.062762 Sep 11 06:07:08.508028 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1871/3980] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 11 06:07:08 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:08.598828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:08.601474 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:08.610718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.612366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.613242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.614334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.615034 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.615686 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.643964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:08.644607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:08.673138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.674374 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.674965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.675772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:08.689605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:08.694553 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:08.781339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1240c7b-d2a1-4257-990e-b9321de8aa1a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186533 Sep 11 06:07:08.811212 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2110/3981] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:08 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:09.097391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:09.109548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:09.112062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:09.113803 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-776fa381-6c24-442a-b077-3bcb0322d516 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.475757 Sep 11 06:07:09.120513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1872/3982] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:08 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:09.802323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:09.805127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:09.831865 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:09.834276 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:09.834913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:09.838999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:09.839743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:09.840407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:09.909898 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e043eac0-c2d8-4890-ad14-cec4f51b61a5 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113826 Sep 11 06:07:09.911539 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2111/3983] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:09 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 06:07:09.992084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:09.993182 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:10.001199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.001973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.002600 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.003599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.004285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.004867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.040796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:07:10.145019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:10.151703 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:10.197113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.202047 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.202501 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.203275 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.203768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.204232 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.264967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c445f01c-c919-4804-aebc-444aef8c06ec tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 204 len: 0 microversion: 2.1 time: 0.279565 Sep 11 06:07:10.269739 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1873/3984] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:07:09 2022] DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 06:07:10.284535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03e42355-d036-4739-967c-c606f7b85665"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:10.291100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:10.304497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.305009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.305436 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.306191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.306655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.307074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.475563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:10.485808 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:10.488761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:10.490432 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f92f7696-7020-4c7a-9e1e-bc4c20c494b6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.353323 Sep 11 06:07:10.504065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2112/3985] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:10 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:10.504065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:10.504065 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:10.509033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.509524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.509966 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.510664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:10.511127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:10.511557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:10.827683 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:10.840809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d804c99-820a-4358-898e-e3d8cadfddf6 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1681 microversion: 2.1 time: 0.343173 Sep 11 06:07:10.841814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2113/3986] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:10 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1681 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:10.921003 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05bd9e16-130c-47b1-bc4e-b6a5c86d0d3f tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "POST /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649571 Sep 11 06:07:10.921625 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1874/3987] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 06:07:10 2022] POST /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:11.515734 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:11.520666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:11.542058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:11.542576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:11.545866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:11.547850 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:11.548538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:11.551089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:11.778514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:11.789070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:11.790882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:11.792274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4ae0a1a-4609-4269-90a9-f8682c5dfbf8 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.280394 Sep 11 06:07:11.795076 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2114/3988] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:11 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:11.867939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:11.868824 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:11.878035 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:11.882228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:11.882789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:11.889100 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:11.889906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:11.890579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:12.190675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:12.201829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-240b18d7-9ea0-4a28-8eb8-5533dbf31a2c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1681 microversion: 2.1 time: 0.338194 Sep 11 06:07:12.203115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1875/3989] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:11 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1681 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:12.824605 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:12.825852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:12.843183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:12.843855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:12.845412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:12.847481 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:12.851558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:12.856725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:12.919173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076459f2-fb04-482c-a87a-fb95f2bc085e", "name": "network-vif-deleted", "tag": "f74433ac-8a09-40d2-96de-91cba19d8482"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:12.948866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:12.958338 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:12.959169 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:13.022796 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] Creating event network-vif-deleted:f74433ac-8a09-40d2-96de-91cba19d8482 for instance 076459f2-fb04-482c-a87a-fb95f2bc085e on hv-cinder-85692 Sep 11 06:07:13.038000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6509e9fd-2110-4da7-a89e-3c67b804dafe req-3d50610b-62fe-4bf9-8f99-047637cc07a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119032 Sep 11 06:07:13.040753 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1876/3990] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:13.147444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:13.174494 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:13.176603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:13.177855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff0c5d0c-b8af-4e7f-858a-2bef36ebaca1 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.357293 Sep 11 06:07:13.178476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2115/3991] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:12 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:13.227249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:13.229368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:13.241857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:13.243681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:13.244375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:13.245342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:13.248269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:13.249243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:13.315964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:13.316685 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:13.317759 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:13.318372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'fault' on Instance uuid 076459f2-fb04-482c-a87a-fb95f2bc085e {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:13.395218 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:13.405266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8496879c-23b4-41a2-b5ee-508caf7b405b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 200 len: 1332 microversion: 2.1 time: 0.182495 Sep 11 06:07:13.407210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1877/3992] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:13 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 1332 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:14.203166 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:14.204421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:14.216743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:14.221660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:14.224223 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:14.228043 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:14.230830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:14.231286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:14.434180 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:14.436391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:14.453582 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:14.454263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:14.454841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:14.457665 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:14.458667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:14.459406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:14.507222 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:07:14.507636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e HTTP/1.1 Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:07:14.521914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:07:14.523395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '076459f2-fb04-482c-a87a-fb95f2bc085e'} Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:14.524297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:07:14.525752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:14.531547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:14.533654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8e1fad6-e427-452c-b53a-cd32d8c5194c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 404 len: 111 microversion: 2.1 time: 0.107313 Sep 11 06:07:14.534265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:14.536596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:14.543576 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1878/3993] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:14 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:14.545235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f89a36c7-ba50-4bfc-b75b-7bb060c1ae94 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.345830 Sep 11 06:07:14.554782 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe7a2b47-eb59-4464-9ee1-be3a8fe2dfb1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '.version_select at 0x7f2c3f199dc0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:14.560167 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2116/3994] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:14 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:14.606047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe7a2b47-eb59-4464-9ee1-be3a8fe2dfb1 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137103143" status: 202 len: 0 microversion: 2.1 time: 0.057929 Sep 11 06:07:14.615285 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1879/3995] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 11 06:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137103143 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:07:15.575508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:15.577564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:15.591020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:15.591525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:15.591973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:15.592721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:15.601376 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:15.604042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:15.684939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7a7178e-da75-4e2d-a5b9-458a2ba532ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: .version_select at 0x7f2c3f253dc0>, body: {"keypair": {"name": "tempest-keypair-958977614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZyhxo0HKh4mZdGk4zu9aZIi95UtlREHVNF33avNBY2ddw4FmH2gN8DHCp4CT0vQlUytgqTRU+SIkgglF/PFpB/amMAb8UU+MIfiPSbE7+almtoWU9vWre8RWQcYuVuiQ=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:15.707828 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-c7a7178e-da75-4e2d-a5b9-458a2ba532ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:07:15.713945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-c7a7178e-da75-4e2d-a5b9-458a2ba532ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:07:15.755118 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7a7178e-da75-4e2d-a5b9-458a2ba532ab tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074346 Sep 11 06:07:15.763575 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1880/3996] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 06:07:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:15.839369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:15.852563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:15.856209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:15.857430 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d15605d9-ae02-43b8-b1c5-f475ec9e1a8c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.286637 Sep 11 06:07:15.860453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2117/3997] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:15 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:16.886829 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:16.887446 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:16.903044 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:16.903758 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:16.904383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:16.905421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:16.906038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:16.906638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:17.150667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:17.160047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:17.165193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:17.170191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8dd85f8-4830-451e-928a-f5d829e7bc06 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.283777 Sep 11 06:07:17.170798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1881/3998] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:16 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:17.639074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-257024576", "imageRef": "00f61779-4a28-49b8-a0c6-84833a5616d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42ad47aa-0576-4a66-864b-0cf4e79a54c6"}], "security_groups": [{"name": "tempest-securitygroup--1045947143"}], "key_name": "tempest-keypair-958977614", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:17.790562 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] validate_networks() for [('42ad47aa-0576-4a66-864b-0cf4e79a54c6', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 06:07:18.197190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:18.215540 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:18.221334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:18.239947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:18.241406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:18.242096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:18.243042 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:18.243699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:18.246228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:18.390204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 06:07:18.396613 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 06:07:18.398945 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 06:07:18.399550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 06:07:18.401836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 06:07:18.412689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=55 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:18.419929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:18.420768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:18.421374 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:18.422425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:18.423039 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:18.423689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:18.446521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:07:18.451134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Getting quotas for user 54b72a430d9d4d43954eb56d703079b4 and project 0a79d2a9724e49a9934d9ca0184b31fd. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:07:18.468839 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 06:07:18.472663 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00f61779-4a28-49b8-a0c6-84833a5616d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 06:07:18.474226 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:18.483382 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:18.484868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:18.486116 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a3c7104-a521-4a0c-adaa-ac1a9d5864ba tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.294518 Sep 11 06:07:18.506847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1882/3999] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:18 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:18.540245 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd574f2a-d45f-4ed9-8750-0897014f409b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.908609 Sep 11 06:07:18.541428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2118/4000] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 06:07:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 06:07:18.554580 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9163a19-767c-4cf4-82fd-a6371b68ba17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:18.555440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9163a19-767c-4cf4-82fd-a6371b68ba17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:18.707837 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9163a19-767c-4cf4-82fd-a6371b68ba17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:18.718445 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9163a19-767c-4cf4-82fd-a6371b68ba17 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1240 microversion: 2.1 time: 0.169630 Sep 11 06:07:18.742872 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1883/4001] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:18 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:19.513074 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:19.519423 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:19.529271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:19.530143 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:19.530798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:19.531724 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:19.532424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:19.533109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:19.730463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:19.746195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:19.747969 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:19.748424 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:19.755657 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:19.757278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e075299f-09bd-4633-9ca4-09c2d8d2d5bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.248582 Sep 11 06:07:19.762431 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:19.762928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:19.763372 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:19.770153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:19.774822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:19.776221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:19.787763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2119/4002] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:19 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:19.893317 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:19.911579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5f31d373-3e72-4e8b-8e23-020d4074524e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1292 microversion: 2.1 time: 0.167957 Sep 11 06:07:19.913675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1884/4003] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:19 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1292 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:20.082857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:20.085774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:20.092445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.092948 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.093400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.094310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.094779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.095213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.133129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c470968-6dad-4956-b213-1ddb100baa4b tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054897 Sep 11 06:07:20.140353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2120/4004] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:20 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:20.294637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:20.295313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:20.302324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.303012 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.303559 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.304675 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.305220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.305903 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.341939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d67aebb5-1f51-453d-a51d-78c4df59c632 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec" status: 200 len: 194 microversion: 2.1 time: 0.051779 Sep 11 06:07:20.342798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1885/4005] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 11 06:07:20 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:20.356716 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:20.357538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:20.395792 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.400550 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.405794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.406521 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.409397 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.409906 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.663796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lazy-loading 'services' on Instance uuid 1b09ca0e-78cf-4155-8c2f-522d8530e750 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:20.786659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:20.787270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:20.799454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.803768 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.804513 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.807277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.807727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.808321 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.863348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f56b8ee1-4fff-4c8b-b4aa-f18ad1e71e56 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec" status: 202 len: 0 microversion: 2.1 time: 0.513178 Sep 11 06:07:20.864235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2121/4006] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 06:07:20 2022] DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/51807b2d-8051-48a3-8ed9-318e52769dec => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:07:20.937428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:20.940398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:20.947571 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.948345 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.949363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:20.950281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:20.951033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:20.951894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:21.085141 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:21.094455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54af23c6-ee47-42a6-846e-759b4c7c71f3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1298 microversion: 2.1 time: 0.161991 Sep 11 06:07:21.111580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2122/4007] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:20 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:21.386722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:21.397124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:21.401787 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:21.409377 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5d0959e-daf4-4d46-a0ec-1de05794e756 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.626481 Sep 11 06:07:21.424904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1886/4008] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:20 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:22.122304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:22.123636 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:22.131456 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:22.132196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:22.132787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:22.133668 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:22.134334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:22.134934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:22.293762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:22.302057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab450b3f-0835-4469-bda1-69a0166a7975 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.187098 Sep 11 06:07:22.326281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2123/4009] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:22 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:22.435476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:22.436150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:22.442652 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:22.443136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:22.443574 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:22.444325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:22.444945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:22.445373 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:22.670124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:22.674819 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:22.680777 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:22.682272 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:22.683695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51d39969-4f9f-4486-861f-607b6ad67f0d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1739 microversion: 2.20 time: 0.252288 Sep 11 06:07:22.684295 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1887/4010] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:22 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:22.796041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744e3264-5a24-4794-853b-34b4690fdf5d", "tag": "a821248e-4aa4-4d5f-b4c8-10594dcb2edd"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:22.809990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:22.810561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:22.811201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:22.822620 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] Creating event network-changed:a821248e-4aa4-4d5f-b4c8-10594dcb2edd for instance 744e3264-5a24-4794-853b-34b4690fdf5d on hv-cinder-85692 Sep 11 06:07:22.827431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-8574857e-c13e-44ab-8788-cc72610f7c3c req-e06000e4-6621-438b-853a-734b5a4f701f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035490 Sep 11 06:07:22.828396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2124/4011] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:23.157278 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:23.159062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:23.170349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.179629 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.181524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.183825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.184680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.185366 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.230412 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbf09ad7-10db-4307-bc3e-d3f614b4f683 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/03e42355-d036-4739-967c-c606f7b85665" status: 200 len: 194 microversion: 2.1 time: 0.077987 Sep 11 06:07:23.237173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1888/4012] 10.222.0.33 () {58 vars in 1413 bytes} [Sun Sep 11 06:07:23 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/03e42355-d036-4739-967c-c606f7b85665 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:23.244214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:23.245403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:23.253338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.254241 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.254836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.255753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.256405 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.256984 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.328865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:23.330078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:23.337224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.337945 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.338542 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.339395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.340200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.341057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.365112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lazy-loading 'services' on Instance uuid 1b09ca0e-78cf-4155-8c2f-522d8530e750 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:23.372434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:23.472352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be4b21db-17dc-4d07-894b-de2f8132d3c0 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/03e42355-d036-4739-967c-c606f7b85665" status: 202 len: 0 microversion: 2.1 time: 0.233000 Sep 11 06:07:23.474121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2125/4013] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 06:07:23 2022] DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments/03e42355-d036-4739-967c-c606f7b85665 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:07:23.572529 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:23.600259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47c3174f-7d21-404b-9607-c9ba75b92aad tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.275133 Sep 11 06:07:23.602755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1889/4014] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:23 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:07:23.710600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:23.711406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:23.717630 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.718134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.718563 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.719282 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:23.719739 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:23.720738 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:23.854262 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:23.863184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:23.864776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:23.866022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42466cd1-9683-405d-8b73-ae0576d85d75 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1721 microversion: 2.20 time: 0.159795 Sep 11 06:07:23.866667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2126/4015] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:23 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:24.629647 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:24.630262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:24.638000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:24.638486 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:24.638928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:24.639632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:24.640280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:24.640705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:24.826947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:24.837221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3fd4ef9a-f33e-47f9-859b-795063395c7a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.211758 Sep 11 06:07:24.840776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1890/4016] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:24 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:24.891062 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:24.891788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:24.898596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:24.899162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:24.899691 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:24.900506 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:24.901035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:24.901530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:25.036740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:25.045161 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:25.046624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:25.047810 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dfdd45b9-2e34-48b8-8a39-48c1527527ac tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1721 microversion: 2.20 time: 0.160712 Sep 11 06:07:25.048970 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2127/4017] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:24 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:25.742228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:25.744970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:25.752023 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:25.752746 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:25.753252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:25.754009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:25.754551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:25.755038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:25.784850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-316d9fae-aff0-4283-87bb-8858f5a37c87 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Sep 11 06:07:25.785624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1891/4018] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:25 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:25.859982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:25.860549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:25.867134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:25.867615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:25.868072 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:25.868762 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:25.869215 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:25.869634 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:25.999086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:26.007610 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0905e72-e0e8-4e15-8de2-ba1fb75e2c0f tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.151502 Sep 11 06:07:26.008194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2128/4019] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:25 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:26.073699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:26.074343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:26.081426 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:26.081921 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:26.082393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:26.083122 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:26.083577 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:26.084021 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:26.214347 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:26.222510 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:26.224115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:26.225293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05557506-d879-44e6-98c0-251a07160a11 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1721 microversion: 2.20 time: 0.155530 Sep 11 06:07:26.225864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1892/4020] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:26 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:26.352638 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "name": "network-vif-unplugged", "status": "completed", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:26.363838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:26.364409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:26.364964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:26.378987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] Creating event network-vif-unplugged:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 06:07:26.383880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-85ea9536-0c8e-426e-8e0e-8b31dffa4a86 req-4dfe8d0a-3cbb-4f9c-8869-f233571208ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035137 Sep 11 06:07:26.384684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2129/4021] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:26.800081 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:26.807417 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:26.816228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:26.816726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:26.817183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:26.818348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:26.819200 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:26.819641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:26.863694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74abafd7-89de-4a26-b6bf-b38acee61476 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069369 Sep 11 06:07:26.864336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1893/4022] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:26 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 06:07:26.996709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:26.999095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.006467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.006952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.007419 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.008139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.008761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.009185 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.030811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:27.031722 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.038598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.039440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.040406 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.041322 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.042802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.043051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-136b724e-8ed7-41e6-96ce-b39967ce3656 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051144 Sep 11 06:07:27.043659 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.049467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2130/4023] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:07:26 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 06:07:27.113037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:27.113523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.119408 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.119894 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.120431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.121131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.121581 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.122006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.148206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:07:27.190985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:27.199236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b983621-8614-4f63-bcf9-92d839498a96 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.172405 Sep 11 06:07:27.200310 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1894/4024] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:27 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:07:27.228831 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adf55259-2204-4596-9bf0-21b523fb1c8d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 204 len: 0 microversion: 2.1 time: 0.119812 Sep 11 06:07:27.229438 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2131/4025] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:07:27 2022] DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 06:07:27.237947 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:27.238658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.244769 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.245259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.245699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.246391 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.246843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.247269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.255377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:27.256176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.262546 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.263044 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.263489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.264231 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.264693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.265124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.418075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:27.426650 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b57c1f82-96d9-462d-b9f6-33b532bcf4a5 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1675 microversion: 2.1 time: 0.192572 Sep 11 06:07:27.427433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1895/4026] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:27 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:27.432651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:27.441754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:27.443297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:27.444516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72551b98-6332-481e-ad87-f60fe1fdbb01 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1724 microversion: 2.20 time: 0.193488 Sep 11 06:07:27.445260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2132/4027] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:27 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:27.469395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ef4cfe1-6368-47a8-8d0f-41b4d906de7b"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:27.472612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.478563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.479052 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.479489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.480212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.480669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.481095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.784922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b257cde5-dcc0-45e5-a1b0-6254f6b9c3be tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319486 Sep 11 06:07:27.785615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1896/4028] 10.222.0.33 () {62 vars in 1364 bytes} [Sun Sep 11 06:07:27 2022] POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 06:07:27.916607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:27.917093 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:27.923019 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.923543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.924199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:27.924909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:27.925366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:27.925794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.199406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd04055a-85e0-45f4-b1c9-a2f622c7b823 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments/2ef4cfe1-6368-47a8-8d0f-41b4d906de7b" status: 202 len: 0 microversion: 2.20 time: 0.286796 Sep 11 06:07:28.200126 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2133/4029] 10.222.0.33 () {60 vars in 1457 bytes} [Sun Sep 11 06:07:27 2022] DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments/2ef4cfe1-6368-47a8-8d0f-41b4d906de7b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 06:07:28.223357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:28.224020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:28.232728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.233718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.233718 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.234356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.234886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.235409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.276784 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:28.277396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:28.284508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.285106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.285557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.286267 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.286725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.287158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.341511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 06:07:28.417059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:28.423772 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-824efd0d-b363-410d-86b5-4058a0723b05 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/action" status: 202 len: 0 microversion: 2.20 time: 0.151513 Sep 11 06:07:28.427835 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c5976ee-fc8f-402c-b5fc-57c9dd570f55 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.205959 Sep 11 06:07:28.429139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2134/4030] 10.222.0.33 () {62 vars in 1319 bytes} [Sun Sep 11 06:07:28 2022] POST /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 06:07:28.434826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:28.435671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:28.443655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:28.445050 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1897/4031] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:28 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:28.446196 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.447129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.447793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.449317 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.450671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.451394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.470741 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:28.471245 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:28.485224 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.487562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.488190 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.490990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:28.491841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:28.492115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:28.492914 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:28.662205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:28.676340 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:28.681158 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:28.682379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-878e002e-ae7f-402b-85c1-f1180dbc29ed tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1672 microversion: 2.20 time: 0.252046 Sep 11 06:07:28.683934 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2135/4032] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:28 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:28.716289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:28.718435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:28.725965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d4e8a76c-75bb-4db2-b49c-e2bee954e850 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1675 microversion: 2.1 time: 0.279764 Sep 11 06:07:28.741512 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1898/4033] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:28 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1675 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:29.522843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:29.524130 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:29.530880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:29.531783 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:29.532246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:29.532982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:29.533721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:29.534133 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:29.714608 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:29.715151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:29.725328 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:29.725851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:29.726325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:29.727286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:29.727919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:29.728583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.170622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:30.182752 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:30.185646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:30.187271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd00c385-5ef0-481f-aa8d-9060e4a91a5a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1672 microversion: 2.20 time: 0.477298 Sep 11 06:07:30.188390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1899/4034] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:29 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1672 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:30.194735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:30.195755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:30.203107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:30.204124 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:30.205242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.206260 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:30.212366 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:30.217997 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:30.221210 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.228271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b574acb-26c0-4294-8fd3-13ba4baefc7b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.709580 Sep 11 06:07:30.231051 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2136/4035] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:29 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:30.263525 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b09ca0e-78cf-4155-8c2f-522d8530e750", "name": "network-vif-deleted", "tag": "684cd5fe-f324-47e4-8aaa-c050ebc7cf3c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:30.286154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:30.287107 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:30.287261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.287680 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lazy-loading 'fault' on Instance uuid 1b09ca0e-78cf-4155-8c2f-522d8530e750 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:30.313832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:30.315222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:30.315355 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.335010 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] Creating event network-vif-deleted:684cd5fe-f324-47e4-8aaa-c050ebc7cf3c for instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 on hv-cinder-85692 Sep 11 06:07:30.343104 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-edf3a300-791a-4b3c-81c7-3bf9520b9dd7 req-6f012050-8454-41c2-a7f0-fa8a1d129939 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109819 Sep 11 06:07:30.351246 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2137/4036] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:30.358729 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:30.368963 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2748c45-ad34-416a-a916-9cdea3cf24e1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1328 microversion: 2.1 time: 0.178008 Sep 11 06:07:30.369955 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1900/4037] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:30 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:30.754296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744e3264-5a24-4794-853b-34b4690fdf5d", "name": "network-vif-plugged", "status": "completed", "tag": "a821248e-4aa4-4d5f-b4c8-10594dcb2edd"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:30.764968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:30.765530 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:30.766150 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:30.779822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] Creating event network-vif-plugged:a821248e-4aa4-4d5f-b4c8-10594dcb2edd for instance 744e3264-5a24-4794-853b-34b4690fdf5d on hv-cinder-85692 Sep 11 06:07:30.785659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-23b9497d-ddde-4b69-ad56-e4263973bf4f req-df3e9a8d-2202-41c0-9dea-7852c16edeeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 Sep 11 06:07:30.786251 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2138/4038] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:31.232263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:31.232902 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:31.251497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.252353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.253056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.253926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.254532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.255195 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.268819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:31.269699 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:31.277377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.278381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.278974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.279828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.280505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.281097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.289659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:31.311442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:31.498288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:31.512935 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:31.514839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:31.516476 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ad1a387-645c-418b-adca-ec54bdde7d36 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.298378 Sep 11 06:07:31.517973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1901/4039] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:31 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:31.523005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:31.523892 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:31.530636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.531470 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.532184 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.533279 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.533954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.534269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:31.534842 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.542782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd714db3-477a-4505-9e22-cfddc0f62591 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.279692 Sep 11 06:07:31.543365 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2139/4040] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:31 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:07:31.575460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:31.575936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:31.576522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:31.577089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lazy-loading 'fault' on Instance uuid 1b09ca0e-78cf-4155-8c2f-522d8530e750 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:07:31.627587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df696da09746748786b94aa8b6721d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47e270753bc4fe6ac5ba1f2b0d5d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:31.636517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15521ac9-bf25-4627-8c40-82a865c9ad0d tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 200 len: 1328 microversion: 2.1 time: 0.117229 Sep 11 06:07:31.637423 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1902/4041] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:31 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:32.546597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:32.547209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:32.557018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.557978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.558334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.559031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.559484 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.559907 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.569514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:32.572076 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:32.581261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.582060 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.582507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.583387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.584104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.584679 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.752667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:32.762862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9af3af29-1fe5-4d07-ad4f-950d42530238 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1366 microversion: 2.1 time: 0.198678 Sep 11 06:07:32.768528 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1903/4042] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:32 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:32.774823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:32.775826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:32.784229 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.784792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.785609 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.786388 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:32.786904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:32.787551 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:32.805939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] HTTP exception thrown: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Request method failure captured: Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 HTTP/1.1 Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJXBl7mhk4T4Y7Fefyl2nFJrnI1Xy7jndGQhSKaohZZPAvfmZ2_UlodbJWrw_AiIIkuiO3xv98grqMeCFA53dg8mo2BTI9q6qH54vm9N2Y8qTVIhCSqz1ewMK-ioeruyqFYZw7bwjXfUhVrKrMTkiOnDBp-nFmecaKqq9EKLmvMblE Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:07:32.808086 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47e270753bc4fe6ac5ba1f2b0d5d2af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}] Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 32df696da09746748786b94aa8b6721d Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:32.809534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '1b09ca0e-78cf-4155-8c2f-522d8530e750'} Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:32.811288 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:32.812714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:32.814735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Returning 404 to user: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:32.814735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8efca580-4843-4d0a-9d6d-ab8b127a576e tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 404 len: 111 microversion: 2.1 time: 0.039291 Sep 11 06:07:32.814735 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1904/4043] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:32 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:32.820700 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56faaa7a-3f54-4842-ad65-eeb2b811227a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '.version_select at 0x7f2c3f253670>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:32.841708 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56faaa7a-3f54-4842-ad65-eeb2b811227a tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818428914" status: 202 len: 0 microversion: 2.1 time: 0.024944 Sep 11 06:07:32.842207 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:32.843056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1905/4044] 10.222.0.33 () {58 vars in 1221 bytes} [Sun Sep 11 06:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818428914 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:07:32.857514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:32.859339 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:32.860838 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a5df637-edac-48c3-a350-2b2d377f2a79 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.318082 Sep 11 06:07:32.862151 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2140/4045] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:32 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:33.788102 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:33.789614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:33.797848 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:33.798479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:33.799034 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:33.807537 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:33.808971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:33.809514 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:33.887642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:33.889233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:33.903536 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:33.906064 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:33.906696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:33.909812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:33.911124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:33.911740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:34.102925 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:34.114349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e289626-4f9c-4b02-b7f2-15cd9a4c4aa3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1555 microversion: 2.1 time: 0.331727 Sep 11 06:07:34.115907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1906/4046] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:33 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:34.140213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:34.143188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:34.144048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:34.151277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:34.152055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:34.152638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:34.153517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:34.154114 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:34.154686 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:34.159816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:34.167788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:34.169233 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d22c667e-e270-4f98-8d3d-399f70825292 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.286704 Sep 11 06:07:34.188021 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2141/4047] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:33 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:34.316489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec7eb6b1-1a41-4756-b98b-4165f64fa642 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179507 Sep 11 06:07:34.317637 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1907/4048] 10.222.0.33 () {58 vars in 1275 bytes} [Sun Sep 11 06:07:34 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:07:35.221447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:35.225986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:35.240348 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:35.240899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:35.241473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:35.242229 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:35.242742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:35.243306 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:35.679870 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:35.691025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:35.692545 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:35.696911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca49e52b-e5ad-4da5-ac50-270a789a9f51 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.493496 Sep 11 06:07:35.707547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2142/4049] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:35 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:35.990583 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744e3264-5a24-4794-853b-34b4690fdf5d", "tag": "a821248e-4aa4-4d5f-b4c8-10594dcb2edd"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:36.010888 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.014622 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.014905 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:36.015307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.015809 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:36.023463 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.024669 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.025328 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.026257 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.026912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.027523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.040704 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] Creating event network-changed:a821248e-4aa4-4d5f-b4c8-10594dcb2edd for instance 744e3264-5a24-4794-853b-34b4690fdf5d on hv-cinder-85692 Sep 11 06:07:36.046645 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-77cd596a-d9d5-4a64-ab70-6e5c0f9d0a65 req-3b6dec92-fd0c-434c-bc7d-50cb01bcda68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073871 Sep 11 06:07:36.047721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1908/4050] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:36.052643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] HTTP exception thrown: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Request method failure captured: Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 HTTP/1.1 Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJXBl7mhk4T4Y7Fefyl2nFJrnI1Xy7jndGQhSKaohZZPAvfmZ2_UlodbJWrw_AiIIkuiO3xv98grqMeCFA53dg8mo2BTI9q6qH54vm9N2Y8qTVIhCSqz1ewMK-ioeruyqFYZw7bwjXfUhVrKrMTkiOnDBp-nFmecaKqq9EKLmvMblE Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:07:36.066369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47e270753bc4fe6ac5ba1f2b0d5d2af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}] Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 32df696da09746748786b94aa8b6721d Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.067635 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '1b09ca0e-78cf-4155-8c2f-522d8530e750'} Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:36.068440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.069623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.070900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Returning 404 to user: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:36.070900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a987609f-0547-4804-8fc4-ec889a5cf1ee tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 404 len: 111 microversion: 2.1 time: 0.057879 Sep 11 06:07:36.072137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2143/4051] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:07:36 2022] DELETE /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:36.080492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:36.081353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 1b09ca0e-78cf-4155-8c2f-522d8530e750] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:36.091789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.094064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.094710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.097636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.098387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.100970 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.120074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] HTTP exception thrown: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Request method failure captured: Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 HTTP/1.1 Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJXBl7mhk4T4Y7Fefyl2nFJrnI1Xy7jndGQhSKaohZZPAvfmZ2_UlodbJWrw_AiIIkuiO3xv98grqMeCFA53dg8mo2BTI9q6qH54vm9N2Y8qTVIhCSqz1ewMK-ioeruyqFYZw7bwjXfUhVrKrMTkiOnDBp-nFmecaKqq9EKLmvMblE Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:07:36.121760 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47e270753bc4fe6ac5ba1f2b0d5d2af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}] Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 32df696da09746748786b94aa8b6721d Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.123185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '1b09ca0e-78cf-4155-8c2f-522d8530e750'} Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:36.124174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. Sep 11 06:07:36.125567 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:36.127990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Returning 404 to user: Instance 1b09ca0e-78cf-4155-8c2f-522d8530e750 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:36.127990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c08db85-b77c-464c-ac33-93846881d8c1 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750" status: 404 len: 111 microversion: 2.1 time: 0.047448 Sep 11 06:07:36.127990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1909/4052] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:36 2022] GET /compute/v2.1/servers/1b09ca0e-78cf-4155-8c2f-522d8530e750 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:36.726733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:36.728278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:36.742451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.743412 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.746289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.747755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:36.748584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:36.749280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:36.948497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:36.958781 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:36.960573 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:36.961972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e885092f-157d-47ea-b1e0-9ea8a6daab0c tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.239536 Sep 11 06:07:36.970756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2144/4053] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:36 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:37.416766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:37.417385 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:37.430205 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:37.431029 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:37.431495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:37.432258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:37.433056 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:37.433641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:37.465825 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] HTTP exception thrown: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Request method failure captured: Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 HTTP/1.1 Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJXBl7mhk4T4Y7Fefyl2nFJrnI1Xy7jndGQhSKaohZZPAvfmZ2_UlodbJWrw_AiIIkuiO3xv98grqMeCFA53dg8mo2BTI9q6qH54vm9N2Y8qTVIhCSqz1ewMK-ioeruyqFYZw7bwjXfUhVrKrMTkiOnDBp-nFmecaKqq9EKLmvMblE Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:07:37.468270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47e270753bc4fe6ac5ba1f2b0d5d2af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}] Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 32df696da09746748786b94aa8b6721d Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.470309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '5eca0a65-6128-4887-b447-6d6e1ddc91a5'} Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:37.471233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.472539 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.480900 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Returning 404 to user: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:37.482057 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dfc95afd-dc0d-4d2e-8d9e-cc22bbbd56a3 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 404 len: 111 microversion: 2.1 time: 0.082519 Sep 11 06:07:37.486883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1910/4054] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:07:37 2022] DELETE /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:37.492304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:37.493208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] [instance: 5eca0a65-6128-4887-b447-6d6e1ddc91a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:37.505538 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:37.506329 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:37.506950 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:37.509135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:37.509826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:37.511125 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] HTTP exception thrown: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Request method failure captured: Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 HTTP/1.1 Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJXBl7mhk4T4Y7Fefyl2nFJrnI1Xy7jndGQhSKaohZZPAvfmZ2_UlodbJWrw_AiIIkuiO3xv98grqMeCFA53dg8mo2BTI9q6qH54vm9N2Y8qTVIhCSqz1ewMK-ioeruyqFYZw7bwjXfUhVrKrMTkiOnDBp-nFmecaKqq9EKLmvMblE Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:07:37.558271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47e270753bc4fe6ac5ba1f2b0d5d2af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47e270753bc4fe6ac5ba1f2b0d5d2af"}]}] Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: d47e270753bc4fe6ac5ba1f2b0d5d2af Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1703721246 Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 32df696da09746748786b94aa8b6721d Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1703721246-project Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.559695 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '5eca0a65-6128-4887-b447-6d6e1ddc91a5'} Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:07:37.560467 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. Sep 11 06:07:37.564626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:07:37.566549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] Returning 404 to user: Instance 5eca0a65-6128-4887-b447-6d6e1ddc91a5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:07:37.566549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54cdbbee-5a2c-4169-93a1-c3380cc99595 tempest-AttachVolumeTestJSON-1703721246 tempest-AttachVolumeTestJSON-1703721246-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5" status: 404 len: 111 microversion: 2.1 time: 0.069876 Sep 11 06:07:37.566549 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2145/4055] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:07:37 2022] GET /compute/v2.1/servers/5eca0a65-6128-4887-b447-6d6e1ddc91a5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:07:37.987048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:37.987661 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:37.997481 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:37.997992 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:37.998439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:38.012587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:38.013430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:38.014032 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:38.383325 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:38.392823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:38.394558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:38.395944 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-037c7e59-47ec-474e-8a33-6a0cb273fcd6 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.413221 Sep 11 06:07:38.408745 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1911/4056] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:37 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:39.424175 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:39.425543 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:39.433951 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:39.434710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:39.435360 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:39.436583 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:39.437406 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:39.437895 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:39.670428 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:39.684208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:39.686266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:39.690163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1990eb28-58fe-416d-85d6-a8c234149683 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.270967 Sep 11 06:07:39.708239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2146/4057] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:39 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:40.726104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:40.727721 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:40.743312 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:40.744236 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:40.745985 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:40.747699 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:40.748497 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:40.751136 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:41.144015 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:41.207965 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:41.212242 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:41.214523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0b37d7c-217f-4638-b9b5-92556d7176aa tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.493966 Sep 11 06:07:41.228020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1912/4058] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:40 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:42.242754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:42.244029 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:42.257427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:42.258176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:42.262972 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:42.263710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:42.264219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:42.264650 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:42.556271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:42.572778 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:42.574480 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:42.575858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-478c82aa-b5ae-41a9-a513-c7ca0c825a2b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.336988 Sep 11 06:07:42.595698 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2147/4059] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:42 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:43.608074 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:43.609249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:43.618669 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:43.619357 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:43.620104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:43.621277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:43.621940 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:43.622632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:43.796523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:43.816612 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:43.818070 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:43.819239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09303c68-2639-401b-afa2-bd3747f31101 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.220510 Sep 11 06:07:43.820129 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1913/4060] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:43 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:44.845089 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:44.845909 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:44.852502 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:44.852993 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:44.853439 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:44.854136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:44.854597 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:44.855024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:44.988296 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:44.996642 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:44.998163 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:44.999334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd4006c6-5c8b-448a-b41f-0432007e989e tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.158673 Sep 11 06:07:44.999901 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2148/4061] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:44 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:45.502660 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7bd24ff-57bf-44b0-b730-5b72992ebdf9 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c3f724d30>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:45.553578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7bd24ff-57bf-44b0-b730-5b72992ebdf9 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0e8772ad-88f7-4697-ab03-1fec86790734" status: 200 len: 350 microversion: 2.1 time: 0.055618 Sep 11 06:07:45.554153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1914/4062] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:07:45 2022] GET /compute/v2.1/os-volumes/0e8772ad-88f7-4697-ab03-1fec86790734 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:46.025055 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:46.025670 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:46.032409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:46.032916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:46.033357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:46.034057 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:46.034516 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:46.034944 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:46.165134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:46.173990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:46.175426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:46.176624 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52497865-ed02-4440-a357-c6760f1f711a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.155823 Sep 11 06:07:46.177182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2149/4063] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:46 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:47.202243 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:47.202846 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:47.210335 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:47.210907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:47.211390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:47.212156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:47.212684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:47.213152 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:47.367274 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:47.377693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:47.380711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:47.380711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29409ce9-57db-4c80-9f91-a50ca62d1fe2 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.183116 Sep 11 06:07:47.383967 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1915/4064] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:47 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:47.973277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad3713cb-95a0-45d4-aed9-4c938bc14221 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c4281d280>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:48.023614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad3713cb-95a0-45d4-aed9-4c938bc14221 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/45ea7a21-f5f8-45e3-8cd8-4727c6635e55" status: 200 len: 351 microversion: 2.1 time: 0.053674 Sep 11 06:07:48.029192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2150/4065] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:07:47 2022] GET /compute/v2.1/os-volumes/45ea7a21-f5f8-45e3-8cd8-4727c6635e55 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:48.408451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:48.409091 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:48.411544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:48.417390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:48.417871 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:48.418311 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:48.419008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:48.419464 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:48.419889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:48.576517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:48.593320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:48.595889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:48.597150 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df79a7d0-72d1-4a79-98a6-805b2ae3c25b tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.194324 Sep 11 06:07:48.597710 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1916/4066] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:48 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:49.415263 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-781a6e25-141f-4aa3-8f58-a7eda6051c25 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c428ba430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.466128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-781a6e25-141f-4aa3-8f58-a7eda6051c25 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0d5ddab0-5a94-45b3-949c-87af1247be22" status: 200 len: 351 microversion: 2.1 time: 0.055241 Sep 11 06:07:49.466785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2151/4067] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes/0d5ddab0-5a94-45b3-949c-87af1247be22 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:49.480022 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffe4f9d5-3b6e-470e-9633-34b54d3bb5ff tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c3f2cc0d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.566020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffe4f9d5-3b6e-470e-9633-34b54d3bb5ff tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089708 Sep 11 06:07:49.566762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1917/4068] 10.222.0.33 () {58 vars in 1134 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:49.589315 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-184b819b-64ec-4a17-a0f0-40a9f53203cf tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c428baaf0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.624821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.625584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:49.633597 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:49.634262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:49.634806 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:49.635626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:49.636208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:49.636731 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:49.680407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-184b819b-64ec-4a17-a0f0-40a9f53203cf tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094742 Sep 11 06:07:49.681188 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2152/4069] 10.222.0.33 () {58 vars in 1149 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:49.695755 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab5194be-4f7f-4aae-8072-4c936b1fea43 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c4293c280>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.792614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:49.798253 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab5194be-4f7f-4aae-8072-4c936b1fea43 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106795 Sep 11 06:07:49.798943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2153/4070] 10.222.0.33 () {58 vars in 1134 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:49.807681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:49.807681 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:49.808646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2511024d-1eb8-44b8-bdd6-53234adfa5de tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.185369 Sep 11 06:07:49.809271 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1918/4071] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 06:07:49.813320 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-754655d3-9f2d-4c4d-9c9e-936a6e83ca6f tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c42904d30>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.899737 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-754655d3-9f2d-4c4d-9c9e-936a6e83ca6f tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090135 Sep 11 06:07:49.900407 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2154/4072] 10.222.0.33 () {58 vars in 1167 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:49.914095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c1bd228-7333-42c4-b0a0-ffe1a9c78738 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c3f2ccdc0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:49.998505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c1bd228-7333-42c4-b0a0-ffe1a9c78738 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088172 Sep 11 06:07:49.999149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1919/4073] 10.222.0.33 () {58 vars in 1170 bytes} [Sun Sep 11 06:07:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:50.013615 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33a6371d-2f39-4e15-95e8-6c62386425ec tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c42848ee0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:50.103836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33a6371d-2f39-4e15-95e8-6c62386425ec tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093902 Sep 11 06:07:50.104448 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2155/4074] 10.222.0.33 () {58 vars in 1155 bytes} [Sun Sep 11 06:07:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:07:50.119043 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c82c9c0-99f7-4a11-be30-a16a55ad2e45 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c3f2530d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:50.204053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c82c9c0-99f7-4a11-be30-a16a55ad2e45 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088779 Sep 11 06:07:50.204615 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1920/4075] 10.222.0.33 () {58 vars in 1188 bytes} [Sun Sep 11 06:07:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:50.217871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20bd3992-bf7b-4156-ae39-fee9feea1599 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] Calling method '.version_select at 0x7f2c42848820>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:50.300756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20bd3992-bf7b-4156-ae39-fee9feea1599 tempest-VolumesTestJSON-943513656 tempest-VolumesTestJSON-943513656-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086686 Sep 11 06:07:50.301324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2156/4076] 10.222.0.33 () {58 vars in 1155 bytes} [Sun Sep 11 06:07:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:07:50.835173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:50.835778 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:50.841891 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:50.842545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:50.842980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:50.843751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:50.848047 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:50.848684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:50.990627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:50.998766 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:51.000254 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:51.002025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a27f1a34-7235-4c49-9450-e7310bc9034a tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.171561 Sep 11 06:07:51.002584 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1921/4077] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:50 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:52.027517 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:52.028182 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:52.030071 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:07:52.036325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:52.036819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:52.037258 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:52.038099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:52.038566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:52.038996 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:52.171804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:52.180693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:52.182415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:52.183595 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da732d0a-43a4-4bbe-b7e5-35402da2da39 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.160559 Sep 11 06:07:52.185054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2157/4078] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:52 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:53.210786 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:53.211395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:53.217771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:53.218258 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:53.218695 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:53.219605 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:53.220090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:53.220524 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:53.351841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:53.360162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:53.362008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:53.363196 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97a0b505-c576-4ab3-9709-2d7c4f2f0cdf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.156865 Sep 11 06:07:53.363762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1922/4079] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:53 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:54.389256 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:54.390763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:54.401011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:54.401011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:54.401011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:54.411535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:54.412239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:54.412725 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:54.593433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:54.603180 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:54.604952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:54.606455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad3f2c9c-ce90-4a08-a803-3bfcfa9e7f61 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.221482 Sep 11 06:07:54.613033 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2158/4080] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:54 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:54.635875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "name": "network-vif-plugged", "status": "completed", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:07:54.651265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:54.652077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:54.652898 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:54.667041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] Creating event network-vif-plugged:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 06:07:54.673948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-e5d43505-9391-424a-870e-648440e5eefe req-65cc027c-3bb5-4853-a00d-ed24ab8b496a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041207 Sep 11 06:07:54.674561 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1923/4081] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:07:55.634498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:55.634977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:55.642201 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:55.642655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:55.643098 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:55.643796 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:55.644457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:55.645145 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:55.793936 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:55.810733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:55.812489 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:55.814547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01b4d231-1ac8-4b82-a347-7770b2972323 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.184442 Sep 11 06:07:55.815464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2159/4082] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:55 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:56.843447 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:56.844833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:56.852772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:56.853709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:56.853908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:56.854742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:56.855368 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:56.855916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:57.014159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:57.040455 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:57.042208 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:57.043437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc81f4f2-36e8-484c-b825-e0a0633698bf tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1730 microversion: 2.20 time: 0.205184 Sep 11 06:07:57.052502 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1924/4083] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:56 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:07:58.071987 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:07:58.073265 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:07:58.080776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:58.081508 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:58.082023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:58.082802 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:07:58.083336 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:07:58.083837 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:07:58.229070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:58.238356 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:58.239798 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:07:58.241000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f24342de-c844-4a3d-b206-4faf83c28c40 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1717 microversion: 2.20 time: 0.175560 Sep 11 06:07:58.241552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2160/4084] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:07:58 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:09:03.106392 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=11 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:09:03.107139 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=90 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:09:03.108678 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:09:03.108821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/ips (ip 10.222.0.33) !!! Sep 11 06:09:03.360283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:03.360811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:03.367689 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:03.368270 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:03.368770 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:03.369518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:03.370039 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:03.370523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:03.393789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cbe7e653-626a-4187-a471-a15f4382a524 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/ips" status: 200 len: 149 microversion: 2.1 time: 0.288993 Sep 11 06:09:03.394387 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1925/4085] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:09:03 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/ips => generated 149 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:09:04.751955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=7 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:09:04.752795 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=81 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:09:04.757785 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe2ac67e-f58b-457a-a812-d859f812b376"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:09:04.760121 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:04.767048 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:04.767534 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:04.767973 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:04.769334 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:04.769793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:04.770220 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:05.050184 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1455a68a-983c-4c45-a456-5e1b99e0e0f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "POST /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299118 Sep 11 06:09:05.050914 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2161/4086] 10.222.0.33 () {60 vars in 1323 bytes} [Sun Sep 11 06:09:04 2022] POST /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:09:08.623843 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:08.626188 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:08.632877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.633355 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.633790 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:08.634474 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.634924 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.635344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:08.664638 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12fe2467-d61e-432c-9a10-3d5093f775da tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044727 Sep 11 06:09:08.665197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1926/4087] 10.222.0.33 () {60 vars in 1343 bytes} [Sun Sep 11 06:09:08 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:09:08.731626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:08.732269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:08.739790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.743667 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.744140 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:08.745139 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.745604 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.746168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:08.774137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:09:08.854003 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fce1eaba-04a1-4656-bda1-e4013d2010e9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 204 len: 0 microversion: 2.20 time: 0.126354 Sep 11 06:09:08.854782 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2162/4088] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 11 06:09:08 2022] DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 06:09:08.865275 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:08.865883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:08.871802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.872323 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.872772 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:08.873460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:08.873913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:08.874340 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:09.139714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:09.148961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:09.150384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:09.151541 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f069f920-1fc2-49c5-baf1-e09d5eddd75d tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.291381 Sep 11 06:09:09.152119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1927/4089] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:08 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:09:10.178678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:10.179383 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:10.185960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:10.186446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:10.186882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:10.187580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:10.188061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:10.188490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:10.318129 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:10.326435 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:10.327880 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:10.329094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9c83d97-4300-4b1a-b65a-875c6f2fd884 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1723 microversion: 2.20 time: 0.155152 Sep 11 06:09:10.329904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2163/4090] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:10 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:09:11.355297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:11.356401 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:11.363913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:11.364552 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:11.365092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:11.366145 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:11.366816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:11.367330 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:11.436763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:11.447896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:11.450411 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:11.451991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c501b33b-16a2-4ac5-8175-1fd9b24f8287 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1655 microversion: 2.20 time: 0.100784 Sep 11 06:09:11.453259 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1928/4091] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:11 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:09:11.658049 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa924fd1-fde8-4e57-a0d3-fc002d20231a", "name": "network-vif-deleted", "tag": "5e05b50d-9e60-4359-a349-3bfe357130ce"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:09:11.671387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:11.675378 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:11.676114 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:11.688812 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] Creating event network-vif-deleted:5e05b50d-9e60-4359-a349-3bfe357130ce for instance aa924fd1-fde8-4e57-a0d3-fc002d20231a on hv-cinder-85692 Sep 11 06:09:11.694933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-6f0a4749-3ad9-4945-8afb-124e6eb6e2c7 req-28d5eaf8-11f3-4f75-b254-ca5c8f4d5af8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049546 Sep 11 06:09:11.696168 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2164/4092] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:09:12.477958 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:12.478578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:12.497750 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:12.504980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:12.505572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:12.506403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:12.506957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:12.507725 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:12.560212 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:12.560712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:12.561161 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:12.561619 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lazy-loading 'fault' on Instance uuid aa924fd1-fde8-4e57-a0d3-fc002d20231a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:09:12.623666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:12.633646 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:12.635088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1dbe40cb994491bafc6ce1f947f4f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c662b75f1d46619c3993132d413549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:12.636283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de2513ee-937e-48a8-ab0e-f77182a5085f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 200 len: 1371 microversion: 2.20 time: 0.162276 Sep 11 06:09:12.637156 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1929/4093] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:12 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 06:09:12.861254 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:12.863008 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:12.875584 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:12.878771 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:12.879352 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:12.880395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:12.882105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:12.883084 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:12.983684 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'services' on Instance uuid 744e3264-5a24-4794-853b-34b4690fdf5d {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:09:13.063874 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eed06d56-c2ac-4463-9bad-c79a10a1e6f9 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments/fe2ac67e-f58b-457a-a812-d859f812b376" status: 202 len: 0 microversion: 2.1 time: 0.206858 Sep 11 06:09:13.064504 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2165/4094] 10.222.0.33 () {58 vars in 1416 bytes} [Sun Sep 11 06:09:12 2022] DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments/fe2ac67e-f58b-457a-a812-d859f812b376 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:09:13.073217 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:13.075489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:13.083235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:13.083897 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:13.084656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:13.085454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:13.085867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:13.087005 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:13.122045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d2f7e6c8-de6a-4355-9f69-28ede85b9e8c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052650 Sep 11 06:09:13.126008 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1930/4095] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:09:13 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:09:13.675744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:13.676756 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:13.685222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:13.685779 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:13.686431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:13.687205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:13.687653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:13.688335 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:13.702866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] HTTP exception thrown: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Request method failure captured: Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a HTTP/1.1 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJZWWja5PTMLZ6H4hQfTFmCKt4a0yDj11dehREKxEG5qbE5ke0VJCCTpu2rXdg8g0mEEVPtxHawy7O9162coVDgkEW8DL4-qOjMwr4eNucN84624EtoKGc3b2e3MDvmxVADs9gAVFsR33RayZqP4f8SA6W9qkugTy6uMAnl8EiBz58 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:13.704599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37c662b75f1d46619c3993132d413549", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37c662b75f1d46619c3993132d413549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}] Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 0d1dbe40cb994491bafc6ce1f947f4f6 Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:13.706780 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'aa924fd1-fde8-4e57-a0d3-fc002d20231a'} Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:13.707857 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:13.709447 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:13.710455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Returning 404 to user: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:13.710455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd414b0a-9e0f-431f-8536-92e558d9b7f9 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 404 len: 111 microversion: 2.20 time: 0.035586 Sep 11 06:09:13.710455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2166/4096] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:13 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 06:09:13.715867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f88a6b1-46c6-44d8-b730-7b4468b90d86 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '.version_select at 0x7f2c3f2cc9d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:13.737046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f88a6b1-46c6-44d8-b730-7b4468b90d86 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818532553" status: 204 len: 0 microversion: 2.20 time: 0.024970 Sep 11 06:09:13.737724 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1931/4097] 10.222.0.33 () {60 vars in 1259 bytes} [Sun Sep 11 06:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818532553 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 06:09:14.134391 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:14.137321 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:14.144741 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.145308 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.145819 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.146607 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.147379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.147873 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.179677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-392f07f0-02a0-4996-b397-0475209ac51c tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049214 Sep 11 06:09:14.180396 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2167/4098] 10.222.0.33 () {58 vars in 1302 bytes} [Sun Sep 11 06:09:14 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 06:09:14.246126 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:14.246857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:14.261248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.269596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.270115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.270889 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.271316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.272105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.305880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:09:14.413883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48200c68-3e88-4237-998e-30d06a74819b tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 204 len: 0 microversion: 2.1 time: 0.171339 Sep 11 06:09:14.414717 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1932/4099] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:09:14 2022] DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 06:09:14.423135 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:14.424035 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:14.431429 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.432815 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.433680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.434585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:14.435341 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:14.435986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:14.594832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:14.602709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d42bb41a-19d4-4437-8ce5-f546b715ed88 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1680 microversion: 2.1 time: 0.183756 Sep 11 06:09:14.603279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2168/4100] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:14 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:09:15.556797 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:15.557475 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:15.563943 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.564532 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.565059 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.565773 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.566238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.566666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.581938 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] HTTP exception thrown: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Request method failure captured: Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a HTTP/1.1 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJZWWja5PTMLZ6H4hQfTFmCKt4a0yDj11dehREKxEG5qbE5ke0VJCCTpu2rXdg8g0mEEVPtxHawy7O9162coVDgkEW8DL4-qOjMwr4eNucN84624EtoKGc3b2e3MDvmxVADs9gAVFsR33RayZqP4f8SA6W9qkugTy6uMAnl8EiBz58 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:15.583684 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37c662b75f1d46619c3993132d413549", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37c662b75f1d46619c3993132d413549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}] Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 0d1dbe40cb994491bafc6ce1f947f4f6 Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.585302 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'aa924fd1-fde8-4e57-a0d3-fc002d20231a'} Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:15.586106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.587293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.588643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Returning 404 to user: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:15.588643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a06242b-2da6-4822-b823-fad5f0d940a5 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 404 len: 111 microversion: 2.20 time: 0.032543 Sep 11 06:09:15.588643 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1933/4101] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 11 06:09:15 2022] DELETE /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 06:09:15.593856 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:15.594478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: aa924fd1-fde8-4e57-a0d3-fc002d20231a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:15.601770 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.602260 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.602700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.603394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.603858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.604324 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.619063 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] HTTP exception thrown: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Request method failure captured: Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a HTTP/1.1 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJZWWja5PTMLZ6H4hQfTFmCKt4a0yDj11dehREKxEG5qbE5ke0VJCCTpu2rXdg8g0mEEVPtxHawy7O9162coVDgkEW8DL4-qOjMwr4eNucN84624EtoKGc3b2e3MDvmxVADs9gAVFsR33RayZqP4f8SA6W9qkugTy6uMAnl8EiBz58 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:15.620666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37c662b75f1d46619c3993132d413549", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37c662b75f1d46619c3993132d413549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}] Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 0d1dbe40cb994491bafc6ce1f947f4f6 Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.622433 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'aa924fd1-fde8-4e57-a0d3-fc002d20231a'} Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:15.623558 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. Sep 11 06:09:15.624933 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:15.626160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Returning 404 to user: Instance aa924fd1-fde8-4e57-a0d3-fc002d20231a could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:15.626160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1d23e0f-8982-44b9-a086-ad72da4d0b31 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a" status: 404 len: 111 microversion: 2.20 time: 0.032359 Sep 11 06:09:15.626160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2169/4102] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:15 2022] GET /compute/v2.1/servers/aa924fd1-fde8-4e57-a0d3-fc002d20231a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 11 06:09:15.629868 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:15.630478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:15.637376 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.637875 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.638315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.640547 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:15.641018 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:15.641454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:15.795522 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:15.804168 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82b6d2ad-a418-4183-9f4d-2142a3bc8cf7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1680 microversion: 2.1 time: 0.181721 Sep 11 06:09:15.805104 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1934/4103] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:15 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:09:16.783146 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:16.784367 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:16.796183 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.796680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.797116 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.797814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.798274 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.798700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.826511 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] HTTP exception thrown: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.827799 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Request method failure captured: Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe HTTP/1.1 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJZWWja5PTMLZ6H4hQfTFmCKt4a0yDj11dehREKxEG5qbE5ke0VJCCTpu2rXdg8g0mEEVPtxHawy7O9162coVDgkEW8DL4-qOjMwr4eNucN84624EtoKGc3b2e3MDvmxVADs9gAVFsR33RayZqP4f8SA6W9qkugTy6uMAnl8EiBz58 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:16.828704 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37c662b75f1d46619c3993132d413549", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37c662b75f1d46619c3993132d413549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}] Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 0d1dbe40cb994491bafc6ce1f947f4f6 Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.830213 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '2851309b-4933-4d3c-950d-e9d28f857dfe'} Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:16.831000 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.832106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.833189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Returning 404 to user: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:16.833189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee035e63-39bc-43b0-b92f-b6319bde9105 tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 404 len: 111 microversion: 2.20 time: 0.051676 Sep 11 06:09:16.833189 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2170/4104] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Sep 11 06:09:16 2022] DELETE /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 06:09:16.834333 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:16.843269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:16.844747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] [instance: 2851309b-4933-4d3c-950d-e9d28f857dfe] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:16.847038 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.851316 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.852089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.854673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.854866 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.855178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.855282 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.855623 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.855736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.856398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:16.856858 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:16.857287 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:16.883841 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] HTTP exception thrown: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Request method failure captured: Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe HTTP/1.1 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJZWWja5PTMLZ6H4hQfTFmCKt4a0yDj11dehREKxEG5qbE5ke0VJCCTpu2rXdg8g0mEEVPtxHawy7O9162coVDgkEW8DL4-qOjMwr4eNucN84624EtoKGc3b2e3MDvmxVADs9gAVFsR33RayZqP4f8SA6W9qkugTy6uMAnl8EiBz58 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:16.887455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37c662b75f1d46619c3993132d413549", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37c662b75f1d46619c3993132d413549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37c662b75f1d46619c3993132d413549"}]}] Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 37c662b75f1d46619c3993132d413549 Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-822436537 Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 0d1dbe40cb994491bafc6ce1f947f4f6 Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-822436537-project Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.888807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '2851309b-4933-4d3c-950d-e9d28f857dfe'} Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:16.889483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. Sep 11 06:09:16.890561 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:16.891567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] Returning 404 to user: Instance 2851309b-4933-4d3c-950d-e9d28f857dfe could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:16.891567 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7679cc2c-7956-436d-a9e7-11ecb023839f tempest-AttachVolumeShelveTestJSON-822436537 tempest-AttachVolumeShelveTestJSON-822436537-project] 10.222.0.33 "GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe" status: 404 len: 111 microversion: 2.20 time: 0.051934 Sep 11 06:09:16.896025 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2171/4105] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Sep 11 06:09:16 2022] GET /compute/v2.1/servers/2851309b-4933-4d3c-950d-e9d28f857dfe => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 06:09:17.036336 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:17.045403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-639b53d0-66f7-4a93-ac6a-7634664e8b1e tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1680 microversion: 2.1 time: 0.221233 Sep 11 06:09:17.048448 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1935/4106] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:16 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:09:17.813855 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744e3264-5a24-4794-853b-34b4690fdf5d", "name": "network-vif-deleted", "tag": "a821248e-4aa4-4d5f-b4c8-10594dcb2edd"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:09:17.826701 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:17.827398 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:17.828507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:17.847362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] Creating event network-vif-deleted:a821248e-4aa4-4d5f-b4c8-10594dcb2edd for instance 744e3264-5a24-4794-853b-34b4690fdf5d on hv-cinder-85692 Sep 11 06:09:17.853510 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-53feeeff-24f6-46cd-89fa-a4b3a7c0e7a0 req-3a3e9d5d-3e2e-4bc0-a81d-6874ae3adcf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044087 Sep 11 06:09:17.858552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2172/4107] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:09:18.073607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:18.074860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:18.084880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:18.085386 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:18.085827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:18.086719 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:18.087339 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:18.087966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:18.170053 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:18.171303 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:18.171789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:18.172313 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lazy-loading 'fault' on Instance uuid 744e3264-5a24-4794-853b-34b4690fdf5d {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:09:18.228953 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b72a430d9d4d43954eb56d703079b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79d2a9724e49a9934d9ca0184b31fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:09:18.241624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b52dcfba-63a6-49ce-8f52-f6a16b4e0feb tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 200 len: 1330 microversion: 2.1 time: 0.173096 Sep 11 06:09:18.245416 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1936/4108] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:18 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 1330 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:09:19.272239 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:19.273498 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:19.287665 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:19.288209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:19.288655 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:19.289377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:19.290242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:19.290242 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:19.305964 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d HTTP/1.1 Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:19.307651 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:19.308937 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '744e3264-5a24-4794-853b-34b4690fdf5d'} Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:19.309700 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:19.310830 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:19.311804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:19.311804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f86d0b37-63b6-48d4-bf11-d080c61087d3 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 404 len: 111 microversion: 2.1 time: 0.044147 Sep 11 06:09:19.311804 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2173/4109] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:19 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:19.322862 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-892d6cff-89be-451e-9f57-2ed210b2bf7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '.version_select at 0x7f2c3f2f9c10>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:19.345428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-892d6cff-89be-451e-9f57-2ed210b2bf7d tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958977614" status: 202 len: 0 microversion: 2.1 time: 0.027689 Sep 11 06:09:19.349671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1937/4110] 10.222.0.33 () {58 vars in 1218 bytes} [Sun Sep 11 06:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958977614 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:09:21.364637 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:21.365192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:21.391751 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:21.395192 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:21.398864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:21.400085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:21.401107 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:21.401769 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:21.443761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d HTTP/1.1 Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:21.445384 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.446923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '744e3264-5a24-4794-853b-34b4690fdf5d'} Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:21.447862 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.449222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.450690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:21.450690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec2f3d17-6bbc-407a-bae4-34cffbd9fad7 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 404 len: 111 microversion: 2.1 time: 0.087912 Sep 11 06:09:21.450690 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2174/4111] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:09:21 2022] DELETE /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:21.465101 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:21.466352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 744e3264-5a24-4794-853b-34b4690fdf5d] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:21.476191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:21.476865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:21.477487 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:21.478225 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:21.478674 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:21.479105 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:21.499135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d HTTP/1.1 Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:21.502573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.504238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '744e3264-5a24-4794-853b-34b4690fdf5d'} Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:21.508712 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. Sep 11 06:09:21.509917 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:21.510915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 744e3264-5a24-4794-853b-34b4690fdf5d could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:21.510915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5c893d9e-4396-4197-8d59-ad9549d27c32 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d" status: 404 len: 111 microversion: 2.1 time: 0.048383 Sep 11 06:09:21.510915 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1938/4112] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:21 2022] GET /compute/v2.1/servers/744e3264-5a24-4794-853b-34b4690fdf5d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 06:09:22.672515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:22.673672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:22.680367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.680858 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.681306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.682006 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.682457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.682882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.696860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e HTTP/1.1 Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:22.698428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.699633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '076459f2-fb04-482c-a87a-fb95f2bc085e'} Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:22.700815 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.702257 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.703830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:22.703830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-261fdc0d-0964-4fa6-977a-2380589b3173 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 404 len: 111 microversion: 2.1 time: 0.031708 Sep 11 06:09:22.703830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1939/4113] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:09:22 2022] DELETE /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 06:09:22.710307 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:22.710930 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 076459f2-fb04-482c-a87a-fb95f2bc085e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:22.717286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.717775 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.718214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.718904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.719527 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.719959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.733440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e HTTP/1.1 Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:22.734974 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.737877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '076459f2-fb04-482c-a87a-fb95f2bc085e'} Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:22.738654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. Sep 11 06:09:22.740173 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.743159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 076459f2-fb04-482c-a87a-fb95f2bc085e could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:22.743159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47ebc9c8-990d-46a0-8249-7a02a207991a tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e" status: 404 len: 111 microversion: 2.1 time: 0.031662 Sep 11 06:09:22.743159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1940/4114] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:22 2022] GET /compute/v2.1/servers/076459f2-fb04-482c-a87a-fb95f2bc085e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:22.748479 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:22.748976 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:22.755755 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.756289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.756732 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.757434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.758049 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.758657 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.768387 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94edc37f-751a-46d9-adb0-2ed3015719e7 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Action: 'create', calling method: .version_select at 0x7f2c42899e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-788763759", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:09:22.773232 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 HTTP/1.1 Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:22.774926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.776233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '5b2d846a-e822-4339-959c-f0bf2303c954'} Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:22.776908 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.778784 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.780284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:22.780284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a92a538-0020-496f-8c8f-098f5afa47e0 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 404 len: 111 microversion: 2.1 time: 0.031558 Sep 11 06:09:22.780284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1941/4115] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:09:22 2022] DELETE /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 06:09:22.785045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:22.785656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: 5b2d846a-e822-4339-959c-f0bf2303c954] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:22.791705 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.792233 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.792670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.793367 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:22.793834 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:22.794251 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:22.808564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 HTTP/1.1 Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:22.810135 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.811344 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '5b2d846a-e822-4339-959c-f0bf2303c954'} Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:22.812073 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. Sep 11 06:09:22.813850 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:22.816418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance 5b2d846a-e822-4339-959c-f0bf2303c954 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:22.816418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e0de536-7cf5-42af-b283-0d186a2584a8 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954" status: 404 len: 111 microversion: 2.1 time: 0.030633 Sep 11 06:09:22.816418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1942/4116] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:22 2022] GET /compute/v2.1/servers/5b2d846a-e822-4339-959c-f0bf2303c954 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:23.126092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94edc37f-751a-46d9-adb0-2ed3015719e7 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.487889 Sep 11 06:09:23.126721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2175/4117] 10.222.0.33 () {60 vars in 1156 bytes} [Sun Sep 11 06:09:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 489 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 06:09:23.139980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-95bc17cd-7917-4c51-9e1b-280898e79d14 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c3f199430>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:23.192343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-95bc17cd-7917-4c51-9e1b-280898e79d14 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 200 len: 352 microversion: 2.1 time: 0.055978 Sep 11 06:09:23.192936 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1943/4118] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:09:23 2022] GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:09:23.962904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:23.963413 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:23.969926 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:23.970414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:23.971441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:23.972169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:23.972621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:23.973046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:23.985994 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f HTTP/1.1 Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:23.987710 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:23.989170 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c42e41e9-5297-4be5-a77d-6558fdb3b01f'} Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:23.992822 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:23.994437 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:23.995645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:23.995645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-520a8d82-8386-4898-9000-d5a6daa24045 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 404 len: 111 microversion: 2.1 time: 0.031146 Sep 11 06:09:23.995645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2176/4119] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:09:23 2022] DELETE /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:23.999315 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:23.999927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] [instance: c42e41e9-5297-4be5-a77d-6558fdb3b01f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:09:24.007716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:24.008237 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:24.008677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:24.009381 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:09:24.009838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:09:24.010266 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:09:24.026432 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] HTTP exception thrown: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Request method failure captured: Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f HTTP/1.1 Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJJbOnk_Ad2Lp8RcaWvdoXYAji18AH_xqipR5uPnkz-aGZxxXUPimlRi41LrBpv4FEZJH3b8dVLR4woSCA-IejCz_Z-_X_8Xiwb4-eUpdpyPDVLnXfxIcUjYdCD6hrqc57ux1pTxiOrzCj9vnfoDF7OafCW0PJSt5ZPVIiBrt0oA5c Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:09:24.027981 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a79d2a9724e49a9934d9ca0184b31fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a79d2a9724e49a9934d9ca0184b31fd"}]}] Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0a79d2a9724e49a9934d9ca0184b31fd Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1074071238 Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 54b72a430d9d4d43954eb56d703079b4 Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1074071238-project Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:24.029268 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'c42e41e9-5297-4be5-a77d-6558fdb3b01f'} Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:24.034442 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. Sep 11 06:09:24.036286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:09:24.037378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] Returning 404 to user: Instance c42e41e9-5297-4be5-a77d-6558fdb3b01f could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:24.037378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0666eb2c-fa65-4f31-b049-00f0dce43d22 tempest-AttachVolumeNegativeTest-1074071238 tempest-AttachVolumeNegativeTest-1074071238-project] 10.222.0.33 "GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f" status: 404 len: 111 microversion: 2.1 time: 0.034809 Sep 11 06:09:24.037378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1944/4120] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:09:23 2022] GET /compute/v2.1/servers/c42e41e9-5297-4be5-a77d-6558fdb3b01f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:09:24.207205 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4cc84e4-ee76-42dd-a7b5-86bca28cd6ab tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c42848ca0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:24.257369 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4cc84e4-ee76-42dd-a7b5-86bca28cd6ab tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 200 len: 353 microversion: 2.1 time: 0.054639 Sep 11 06:09:24.258395 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2177/4121] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:09:24 2022] GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:09:24.273950 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-652b9aea-3801-4196-bf90-b7c42e8d085d tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c3f372ca0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:24.327267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-652b9aea-3801-4196-bf90-b7c42e8d085d tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 200 len: 353 microversion: 2.1 time: 0.060305 Sep 11 06:09:24.328092 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1945/4122] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:09:24 2022] GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:09:24.347059 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b971a5d4-712b-4e02-b128-57762906a657 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c428ba8b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:24.418426 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b971a5d4-712b-4e02-b128-57762906a657 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 202 len: 0 microversion: 2.1 time: 0.075110 Sep 11 06:09:24.420113 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2178/4123] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:09:24 2022] DELETE /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:09:24.428879 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c50ae5c8-3df7-4453-8b52-a6773dc7f798 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c3f1ea1f0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:24.481031 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c50ae5c8-3df7-4453-8b52-a6773dc7f798 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 200 len: 352 microversion: 2.1 time: 0.056494 Sep 11 06:09:24.481864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1946/4124] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:09:24 2022] GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:09:25.496453 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efd885ce-e99f-444e-9601-44c86d1580c5 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Calling method '.version_select at 0x7f2c4281d8b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:09:25.526531 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-efd885ce-e99f-444e-9601-44c86d1580c5 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] HTTP exception thrown: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efd885ce-e99f-444e-9601-44c86d1580c5 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Request method failure captured: Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a HTTP/1.1 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXuSd4ZtC6df47_Nrfl1a2DC_7sfgU6Xfb_J742GLEEsTuh8hxGRcqNyKRpip6ggncqB2365C6dX7-ueQGVbxakr7xLTqGv3FOMBD_RIPi6Z4inbRN2IjlSq27Fe10rgL6giyg_WLM5wLpGgPrsEPPE-pQT5iS8wpR-YfDuWJF9kck4 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 5846c04e851a48499c81895b21391064 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesGetTestJSON-2014878989 Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:09:25.528541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5846c04e851a48499c81895b21391064", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5846c04e851a48499c81895b21391064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5846c04e851a48499c81895b21391064"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5846c04e851a48499c81895b21391064"}]}] Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesGetTestJSON-2014878989 Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 5846c04e851a48499c81895b21391064 Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesGetTestJSON-2014878989 Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesGetTestJSON-2014878989-project Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: e2eea21de17041a890bddf77e4e519d4 Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesGetTestJSON-2014878989-project Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '508fbb24-de3a-45d7-9231-19a0d280322a'} Sep 11 06:09:25.530018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. (HTTP 404) (Request-ID: req-abd8ab4c-e232-4f9d-a317-15da2032e950) Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:25.534861 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:09:25.536715 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 06:09:25.539648 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efd885ce-e99f-444e-9601-44c86d1580c5 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] Returning 404 to user: Volume 508fbb24-de3a-45d7-9231-19a0d280322a could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efd885ce-e99f-444e-9601-44c86d1580c5 tempest-VolumesGetTestJSON-2014878989 tempest-VolumesGetTestJSON-2014878989-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a" status: 404 len: 109 microversion: 2.1 time: 0.037860 Sep 11 06:09:25.542671 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2179/4125] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:09:25 2022] GET /compute/v2.1/os-volumes/508fbb24-de3a-45d7-9231-19a0d280322a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:10:56.962356 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:10:56.964149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:10:57.238702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb7ffd3e-c6b5-4bb3-b1e5-e9ecafe17052 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Action: 'create', calling method: .version_select at 0x7f2c3f1b5820>, body: {"keypair": {"name": "tempest-TestShelveInstance-2005527364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDuX27QzK8LWvHefpJqQZlHmvUiwyHpMTEF3ivRxTFG9xc55HDOWm8z4NlHa4pSrFBGOZ/iiYvOzDNcxWI/aTXTCsN8lw7kshxoxEmJAirvHJtwasJIQRRhKDH2OOZ0Ag=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:10:57.270883 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-fb7ffd3e-c6b5-4bb3-b1e5-e9ecafe17052 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Getting quotas for project 10427ce4a1644db89943273919d296cc. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:10:57.277037 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-fb7ffd3e-c6b5-4bb3-b1e5-e9ecafe17052 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Getting quotas for user 309d1efd676845bbaa30f472b19ffa34 and project 10427ce4a1644db89943273919d296cc. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:10:57.304831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb7ffd3e-c6b5-4bb3-b1e5-e9ecafe17052 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.344771 Sep 11 06:10:57.308305 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1947/4126] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Sep 11 06:10:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:11:19.537271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b0438782-bb72-4788-bb2c-4997ef4b80ff] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 11 06:11:19.537834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:19.538402 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:19.539673 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 06:11:19.539814 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Sep 11 06:11:19.541134 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:11:19.541269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Sep 11 06:11:19.542216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:11:19.542331 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Sep 11 06:11:19.551244 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-538791871", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2005527364", "security_groups": [{"name": "tempest-secgroup-smoke-2023387548"}], "networks": [{"uuid": "5f6cdbb2-00c4-48f5-b33f-e8cfaed87f7a"}], "block_device_mapping_v2": [{"uuid": "7c60400b-2ca9-40aa-8ca4-db564a74c131", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:11:19.679364 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] validate_networks() for [('5f6cdbb2-00c4-48f5-b33f-e8cfaed87f7a', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 06:11:20.315564 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 06:11:20.316030 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 06:11:20.316507 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 06:11:20.316913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 06:11:20.317319 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 06:11:20.327394 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:20.327836 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:20.328298 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:20.329015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:20.329465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:20.329887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:20.347621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Getting quotas for project 10427ce4a1644db89943273919d296cc. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 06:11:20.351788 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Getting quotas for user 309d1efd676845bbaa30f472b19ffa34 and project 10427ce4a1644db89943273919d296cc. Resources: {'ram', 'instances', 'cores'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 06:11:20.410807 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 06:11:20.413015 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c60400b-2ca9-40aa-8ca4-db564a74c131',volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 06:11:20.559689 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-baf4ecc0-2b4a-4f28-a8ae-d46fb2b27618 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025017 Sep 11 06:11:20.568271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2180/4127] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Sep 11 06:11:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 06:11:20.573587 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07450609-73b7-4167-8fc4-6eff8fa60619 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:20.574284 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07450609-73b7-4167-8fc4-6eff8fa60619 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:20.576345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:20.577627 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:20.654149 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07450609-73b7-4167-8fc4-6eff8fa60619 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:20.661959 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07450609-73b7-4167-8fc4-6eff8fa60619 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1088 microversion: 2.1 time: 0.092367 Sep 11 06:11:20.670614 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1948/4128] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:20 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:21.686593 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:21.687349 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:21.696017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] [b0438782-bb72-4788-bb2c-4997ef4b80ff] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 40096. Sep 11 06:11:21.709882 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:21.710454 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:21.710899 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:21.711625 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:21.719068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:21.719537 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:21.798588 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:21.814297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6f48fcb-9874-4773-9fc6-707fc2021400 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1186 microversion: 2.1 time: 0.132435 Sep 11 06:11:21.820706 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2181/4129] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:21 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:22.838002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:22.838830 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:22.847670 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:22.850371 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:22.851247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:22.854235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:22.861518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:22.862068 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:23.014465 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:23.027822 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c476c31c-3356-4378-8271-a96d2dd6b03f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.193553 Sep 11 06:11:23.043973 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1949/4130] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:22 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:23.489881 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:11:23.503629 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:23.504160 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:23.505102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:23.517222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] Creating event network-changed:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:11:23.524379 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1c782d31-d5d4-4b82-bfed-99dd29ad4b69 req-ff4c5170-6995-403e-9628-0482a00b4473 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039135 Sep 11 06:11:23.524974 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2182/4131] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:11:24.050863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:24.051596 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:24.058220 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:24.058715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:24.059221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:24.059990 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:24.060530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:24.061128 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:24.192395 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:24.200123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa53c73f-ad93-40c4-83ea-736a3d64aed6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.153166 Sep 11 06:11:24.200711 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1950/4132] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:24 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:25.223696 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:25.224431 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:25.231112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:25.231606 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:25.232056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:25.232758 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:25.233217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:25.233633 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:25.446411 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:25.454660 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59b3c4fe-e936-4b40-aeaf-4e33a2654263 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.235210 Sep 11 06:11:25.455497 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2183/4133] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:25 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:26.477560 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:26.478088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:26.485098 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:26.485578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:26.486009 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:26.486698 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:26.487146 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:26.487564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:26.632123 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:26.640155 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9c8ecfe-742f-4ec0-932b-963a635aee46 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.166501 Sep 11 06:11:26.640727 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1951/4134] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:26 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:27.663137 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:27.663742 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:27.670747 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:27.671235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:27.671852 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:27.672566 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:27.673022 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:27.673445 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:27.807893 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:27.816869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4862496d-67b4-48db-9644-14fe227d6ec6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.157506 Sep 11 06:11:27.817533 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2184/4135] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:27 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:28.839570 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:28.840209 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:28.846623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:28.847108 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:28.847546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:28.848263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:28.848720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:28.849154 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:28.979536 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:28.987841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-477c44e0-c2d3-476b-a43e-8e0778aeab54 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.152076 Sep 11 06:11:28.988437 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1952/4136] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:28 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:30.009975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:30.010509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:30.017169 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:30.017656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:30.018124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:30.018813 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:30.019269 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:30.019702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:30.149666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:30.157434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28beb598-568d-4aac-8c8a-22135f1ebd8a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.151432 Sep 11 06:11:30.157998 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2185/4137] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:30 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:31.180504 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:31.181109 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:31.184267 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:31.189025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:31.189509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:31.189942 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:31.190624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:31.191121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:31.191496 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:31.325723 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:31.334162 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e902a5bc-7218-424a-8dc8-757d8b3424cc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.157534 Sep 11 06:11:31.348151 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1953/4138] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:31 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:11:32.356457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:32.357099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:32.359580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:32.360386 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:11:32.366458 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:32.366943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:32.367381 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:32.368094 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:32.368551 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:32.368975 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:32.505046 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:32.512843 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85daf9d1-8ef5-44b5-8ec6-502f703fe55a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.160237 Sep 11 06:11:32.513483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2186/4139] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:32 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:33.536589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:33.537334 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:33.543720 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:33.544247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:33.544694 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:33.546002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:33.546466 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:33.546895 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:33.683654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:33.693319 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-383a66d9-69ec-4250-8d07-dd44baf14f12 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.159984 Sep 11 06:11:33.694269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1954/4140] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:33 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:34.716304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:34.717475 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:34.724028 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:34.724509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:34.724949 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:34.725654 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:34.726111 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:34.726535 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:34.868271 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:34.874513 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbf8e795-3bb9-4e09-9895-4bb0cfcd4a0f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.162064 Sep 11 06:11:34.875281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2187/4141] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:34 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:35.780572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "name": "network-vif-plugged", "status": "completed", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:11:35.794380 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:35.795677 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:35.796134 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:35.810515 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] Creating event network-vif-plugged:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:11:35.816055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-1fb1cb7c-717b-4782-8b7f-f8d45edd977a req-a34c1a09-2e5e-44b1-ae67-ce3cf7011413 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 Sep 11 06:11:35.816986 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1955/4142] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:11:35.897961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:35.898740 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:35.906061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:35.906548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:35.906981 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:35.907662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:35.908138 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:35.908589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:36.090750 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:36.106736 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f9bddae-08e3-4f3a-add4-cd1cb7757438 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.212726 Sep 11 06:11:36.124774 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2188/4143] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:35 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:37.134771 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:37.135478 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:37.143263 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:37.143754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:37.144228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:37.144928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:37.145384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:37.145811 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:37.293507 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:37.301219 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00f17356-6799-4a18-a0fd-68b54c2a35c5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1260 microversion: 2.1 time: 0.172144 Sep 11 06:11:37.301792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1956/4144] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:37 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:38.330664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:38.331279 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:38.337828 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:38.338310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:38.338743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:38.339434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:38.339887 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:38.340333 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:38.470427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:38.478208 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbb8d11c-a631-4c7f-b6ee-45f754ec235e tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1444 microversion: 2.1 time: 0.157352 Sep 11 06:11:38.478801 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2189/4145] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:38 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:38.503247 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:11:38.503853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:11:38.510183 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:38.510662 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:38.511090 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:38.511767 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:38.512238 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:38.512658 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:38.648785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:11:38.656994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8110060-2dfb-484d-ab3c-a31cb4cfafc8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1444 microversion: 2.1 time: 0.157874 Sep 11 06:11:38.657562 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1957/4146] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:11:38 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:11:40.462548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:11:40.473913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:11:40.474377 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:11:40.474848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:11:40.488363 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] Creating event network-changed:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:11:40.493832 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1c9255a6-55bf-4f24-a81c-496d68786dd5 req-3b9e0453-f4b1-4a21-8494-d3fcda43a5d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035685 Sep 11 06:11:40.498816 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2190/4147] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:12:48.386174 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=22 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:12:48.386934 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:12:48.388252 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:12:48.388440 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 (ip 10.222.0.33) !!! Sep 11 06:12:48.393573 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:48.394078 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:48.403742 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:48.404418 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:48.404941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:48.405655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:48.406115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:48.406546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:48.434166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:12:48.516926 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8d4b6b1-0f4b-43f8-99b6-c6a51589f978 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 204 len: 0 microversion: 2.1 time: 0.132120 Sep 11 06:12:48.517904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1958/4148] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:12:48 2022] DELETE /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 06:12:48.524455 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:12:48.525587 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=54 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:12:48.530969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:48.531676 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:48.543552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:48.544099 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:48.544541 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:48.545842 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:48.546465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:48.547012 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:48.816913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:12:48.825280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d870b76d-6a0c-4756-91db-5227d720a2ec tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1509 microversion: 2.1 time: 0.303127 Sep 11 06:12:48.826011 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2191/4149] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:48 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 06:12:49.851314 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:49.852117 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:49.858856 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:49.859346 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:49.859781 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:49.860543 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:49.860999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:49.861422 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:50.004641 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:12:50.017687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8791f297-d842-4a88-9106-bc027908c659 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1509 microversion: 2.1 time: 0.170500 Sep 11 06:12:50.018598 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1959/4150] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:49 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:12:50.329919 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0651b94-3604-4b72-8562-7b252652c725", "name": "network-vif-deleted", "tag": "7b14db7f-83e7-446e-8ada-d567e4c34601"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:12:50.342234 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:50.342955 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:50.343714 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:50.356990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] Creating event network-vif-deleted:7b14db7f-83e7-446e-8ada-d567e4c34601 for instance f0651b94-3604-4b72-8562-7b252652c725 on hv-cinder-85692 Sep 11 06:12:50.363006 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c75e01e1-98a9-4052-a5f0-36fb02a205a9 req-491919ff-d335-4d6e-8b8c-b94aa36f31a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129081 Sep 11 06:12:50.363602 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2192/4151] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:12:51.041922 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:51.042566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:51.050702 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:51.051345 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:51.051795 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:51.052530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:51.053324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:51.053461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:51.093430 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:51.093931 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:51.094518 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:51.094966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lazy-loading 'fault' on Instance uuid f0651b94-3604-4b72-8562-7b252652c725 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:12:51.141865 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:12:51.149235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb6869f9-2c24-45c4-931b-d426cf703285 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 200 len: 1312 microversion: 2.1 time: 0.112205 Sep 11 06:12:51.149802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1960/4152] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:51 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:12:52.173916 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:52.174744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: f0651b94-3604-4b72-8562-7b252652c725] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:52.182255 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.182733 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.183162 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.183854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.184344 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.184761 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.199105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 HTTP/1.1 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:12:52.200867 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: > Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. Sep 11 06:12:52.203488 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'f0651b94-3604-4b72-8562-7b252652c725'} Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:12:52.204732 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. Sep 11 06:12:52.206362 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:12:52.207603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 404 to user: Instance f0651b94-3604-4b72-8562-7b252652c725 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:12:52.207603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c59b209-5917-482c-86ee-c8adb29c42ea tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725" status: 404 len: 111 microversion: 2.1 time: 0.033908 Sep 11 06:12:52.207603 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2193/4153] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:52 2022] GET /compute/v2.1/servers/f0651b94-3604-4b72-8562-7b252652c725 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:12:52.211860 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:52.212378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:52.219957 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.220789 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.221235 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.221928 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.222378 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.222802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.248545 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:12:52.328166 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b68f0dd0-1450-4502-88de-d67cc31a500e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 204 len: 0 microversion: 2.1 time: 0.119699 Sep 11 06:12:52.329083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1961/4154] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:12:52 2022] DELETE /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 06:12:52.338209 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:52.338833 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:52.346415 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.346911 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.347353 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.348095 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:52.348555 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:52.348982 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:52.481799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:12:52.490214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ae5ba61-92c7-45a5-b5fd-6b2061515e9a tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.156306 Sep 11 06:12:52.490773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2194/4155] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:52 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:12:53.514451 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:53.515170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:53.522214 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:53.522715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:53.523471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:53.524390 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:53.524847 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:53.525280 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:53.678413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c978e96d3248d59120c287ecc75e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60788ee7f0ab439087f63db271b65ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:12:53.687471 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a376dff-f7e3-4d23-8874-395f49ebaf75 tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 200 len: 1521 microversion: 2.1 time: 0.177998 Sep 11 06:12:53.688096 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1962/4156] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:53 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:12:53.956912 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ab1d7c-7832-4c37-9d94-7f5ed0c8be89", "name": "network-vif-deleted", "tag": "0aed7b13-2c7e-459b-93dd-179ad088a48e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:12:53.975088 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:53.975560 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:53.976026 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:53.990290 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] Creating event network-vif-deleted:0aed7b13-2c7e-459b-93dd-179ad088a48e for instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 on hv-cinder-85692 Sep 11 06:12:53.996230 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5baf0285-d217-4713-8d4a-013f513c8fbd req-553600b0-b305-4e01-ac8f-5c2bd326b0e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044231 Sep 11 06:12:53.997281 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2195/4157] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:12:54.711460 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:54.712077 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] [instance: 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:12:54.719248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:54.719733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:54.720201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:54.720896 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:12:54.721343 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:12:54.721776 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:12:54.735821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] HTTP exception thrown: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Request method failure captured: Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 HTTP/1.1 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXJN69_ildklVJSNzsmsW0T1V962xNPQprXpRGaIZ0HY238o4MWEzroKVNGIJrWaXzQi3xmiwuRQq5_rdFgNAe9kCyX4zd8TeB4E2pc8IvD8mlY5Almymjzl6-iz6rlUjSu1zAaHhEpU20NhCQJomRmyfhx-a-g5sR_JMa4xhU-RETs Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:12:54.737428 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60788ee7f0ab439087f63db271b65ef4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60788ee7f0ab439087f63db271b65ef4"}]}] Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 60788ee7f0ab439087f63db271b65ef4 Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-287824037 Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4c978e96d3248d59120c287ecc75e87 Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-287824037-project Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. Sep 11 06:12:54.739004 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '20ab1d7c-7832-4c37-9d94-7f5ed0c8be89'} Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:12:54.739910 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. Sep 11 06:12:54.741523 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:12:54.742816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] Returning 404 to user: Instance 20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:12:54.742816 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eacac08a-87d6-453d-8aa3-cfa6253cf39e tempest-ServerRescueNegativeTestJSON-287824037 tempest-ServerRescueNegativeTestJSON-287824037-project] 10.222.0.33 "GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89" status: 404 len: 111 microversion: 2.1 time: 0.031861 Sep 11 06:12:54.745306 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1963/4158] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:12:54 2022] GET /compute/v2.1/servers/20ab1d7c-7832-4c37-9d94-7f5ed0c8be89 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:12:59.249323 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e78676ec-b84c-4fd7-bb7f-2e830f8fdb88 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Action: 'create', calling method: .version_select at 0x7f2c4298cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-730352605"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:12:59.545693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e78676ec-b84c-4fd7-bb7f-2e830f8fdb88 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.411584 Sep 11 06:12:59.546621 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2196/4159] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Sep 11 06:12:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 413 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 06:12:59.558873 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a106b52-2474-4f3e-b6ab-fd4f30b1d20a tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f22f1f0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:12:59.613814 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a106b52-2474-4f3e-b6ab-fd4f30b1d20a tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 200 len: 344 microversion: 2.1 time: 0.058665 Sep 11 06:12:59.614409 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1964/4160] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:12:59 2022] GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:00.629913 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb2d17c5-796c-42c2-b1cf-2da2246c6c8d tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f1071f0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:00.679451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb2d17c5-796c-42c2-b1cf-2da2246c6c8d tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 200 len: 345 microversion: 2.1 time: 0.054526 Sep 11 06:13:00.680031 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2197/4161] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:13:00 2022] GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:00.694954 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b3b052d-80a5-4c22-8cbc-1af83d5665a1 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Action: 'create', calling method: .version_select at 0x7f2c3f2cc430>, body: {"snapshot": {"volume_id": "2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-395084593"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:13:00.854165 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b3b052d-80a5-4c22-8cbc-1af83d5665a1 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163982 Sep 11 06:13:00.855041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1965/4162] 10.222.0.33 () {60 vars in 1162 bytes} [Sun Sep 11 06:13:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:00.866721 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6a10467-66ab-4d88-a9e2-127965f84736 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4288d1f0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:00.902359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6a10467-66ab-4d88-a9e2-127965f84736 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.039699 Sep 11 06:13:00.903009 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2198/4163] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:00 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:00.915352 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-06e53cce-0d9c-490f-b36f-8e1630506ea2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f1ea9d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:00.948089 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-06e53cce-0d9c-490f-b36f-8e1630506ea2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037007 Sep 11 06:13:00.948666 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1966/4164] 10.222.0.33 () {58 vars in 1140 bytes} [Sun Sep 11 06:13:00 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:13:00.960304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eda390fa-84bc-4be7-9883-ad07f928d035 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4298c160>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:00.990960 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eda390fa-84bc-4be7-9883-ad07f928d035 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.034633 Sep 11 06:13:00.991518 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2199/4165] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:00 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:02.003592 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f8c8483-5ceb-47a2-8992-a7ded65df046 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f1b5160>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:02.033863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f8c8483-5ceb-47a2-8992-a7ded65df046 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.034519 Sep 11 06:13:02.034585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1967/4166] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:01 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:03.048159 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c084ac9e-c77f-4da4-8cf9-0f499354a292 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4293c430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:03.078327 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c084ac9e-c77f-4da4-8cf9-0f499354a292 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.035279 Sep 11 06:13:03.078900 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2200/4167] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:03 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:04.092185 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2746381e-9db4-4250-bc58-df6b1d606cf5 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f1993a0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:04.122863 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2746381e-9db4-4250-bc58-df6b1d606cf5 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.035678 Sep 11 06:13:04.123429 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1968/4168] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:04 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:05.133086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=10 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:13:05.133854 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=18 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:13:05.139409 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd54246e-9fa1-4026-8711-e1a342f711dd tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4293c280>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:05.170277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd54246e-9fa1-4026-8711-e1a342f711dd tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.037418 Sep 11 06:13:05.171018 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2201/4169] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:05 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:06.179672 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:13:06.180461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:13:06.185535 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7236125-cfa3-44c1-984d-6d63ed629a6f tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f2ebc10>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:06.217349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7236125-cfa3-44c1-984d-6d63ed629a6f tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 287 microversion: 2.1 time: 0.038414 Sep 11 06:13:06.217913 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1969/4170] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:06 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:06.229449 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bc5ee6f-8528-4412-bb6a-e3c9580d26e0 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4298c0d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:06.292176 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bc5ee6f-8528-4412-bb6a-e3c9580d26e0 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 202 len: 0 microversion: 2.1 time: 0.066862 Sep 11 06:13:06.292748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2202/4171] 10.222.0.33 () {58 vars in 1254 bytes} [Sun Sep 11 06:13:06 2022] DELETE /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:13:06.302509 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e864ae0-f6f7-438b-8907-2444797cf8ba tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f22f550>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:06.331941 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e864ae0-f6f7-438b-8907-2444797cf8ba tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 200 len: 286 microversion: 2.1 time: 0.033922 Sep 11 06:13:06.332556 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1970/4172] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:06 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:07.346085 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8038cf3f-3a75-4f8a-b049-9a2bb47974bc tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c428ba940>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:07.371144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-8038cf3f-3a75-4f8a-b049-9a2bb47974bc tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] HTTP exception thrown: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8038cf3f-3a75-4f8a-b049-9a2bb47974bc tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Request method failure captured: Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 HTTP/1.1 Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXxraS8VAUSTqEB4C_uMk02BGNbUtWYFx7n6wDLcFEx45ivE0_XjcbkyVrzPstORYwug8mGtd-zvyvxJI4spEVUpDsiOjkz1zmx1ux9nyo_5uHuidE7s1c3-uFLqnO_B_CBPBO7MPhPD_cDAsgKhRxoyT8uYWlt4v5ebcm6Xbn091yE Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:13:07.373922 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012dc5fde7946fd8e0315757e7c83bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}] Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 036a3b5a91854a7885a36c160356c884 Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'ca6386c4-a2a0-4615-a730-f38d39766580'} Sep 11 06:13:07.375266 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. (HTTP 404) (Request-ID: req-8641dda6-29cf-4ec2-a2e2-fe76053eb53a) Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.376144 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:07.377285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 06:13:07.378483 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8038cf3f-3a75-4f8a-b049-9a2bb47974bc tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Returning 404 to user: Snapshot ca6386c4-a2a0-4615-a730-f38d39766580 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:13:07.379713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8038cf3f-3a75-4f8a-b049-9a2bb47974bc tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580" status: 404 len: 111 microversion: 2.1 time: 0.034306 Sep 11 06:13:07.380575 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2203/4173] 10.222.0.33 () {58 vars in 1251 bytes} [Sun Sep 11 06:13:07 2022] GET /compute/v2.1/os-snapshots/ca6386c4-a2a0-4615-a730-f38d39766580 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:13:07.383836 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a576856-b854-469f-bc87-1e078aefa09c tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3f2ccdc0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:07.449348 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a576856-b854-469f-bc87-1e078aefa09c tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 202 len: 0 microversion: 2.1 time: 0.069117 Sep 11 06:13:07.449916 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1971/4174] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:13:07 2022] DELETE /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:13:07.459420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc3751d8-618a-40e1-b0ab-c2412688bd9b tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c4281d8b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:07.510359 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc3751d8-618a-40e1-b0ab-c2412688bd9b tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 200 len: 344 microversion: 2.1 time: 0.054659 Sep 11 06:13:07.510799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2204/4175] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:13:07 2022] GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:13:08.526199 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-251d4b35-5e09-48b7-a8b7-63a8ddb38fd2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3ef401f0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:08.556327 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-251d4b35-5e09-48b7-a8b7-63a8ddb38fd2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] HTTP exception thrown: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-251d4b35-5e09-48b7-a8b7-63a8ddb38fd2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Request method failure captured: Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae HTTP/1.1 Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXxraS8VAUSTqEB4C_uMk02BGNbUtWYFx7n6wDLcFEx45ivE0_XjcbkyVrzPstORYwug8mGtd-zvyvxJI4spEVUpDsiOjkz1zmx1ux9nyo_5uHuidE7s1c3-uFLqnO_B_CBPBO7MPhPD_cDAsgKhRxoyT8uYWlt4v5ebcm6Xbn091yE Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:13:08.558546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012dc5fde7946fd8e0315757e7c83bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}] Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 036a3b5a91854a7885a36c160356c884 Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae'} Sep 11 06:13:08.560265 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. (HTTP 404) (Request-ID: req-60c58ec7-f514-41e7-974f-a84ff9870acd) Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.569572 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:08.570932 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 06:13:08.573171 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-251d4b35-5e09-48b7-a8b7-63a8ddb38fd2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Returning 404 to user: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-251d4b35-5e09-48b7-a8b7-63a8ddb38fd2 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 404 len: 109 microversion: 2.1 time: 0.038436 Sep 11 06:13:08.575563 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1972/4176] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:13:08 2022] GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:13:08.576834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-365a4bdf-b514-4955-a213-8888d6a3a605 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c427fb8b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:08.775834 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-365a4bdf-b514-4955-a213-8888d6a3a605 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] HTTP exception thrown: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-365a4bdf-b514-4955-a213-8888d6a3a605 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Request method failure captured: Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae HTTP/1.1 Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.33 Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjHXxraS8VAUSTqEB4C_uMk02BGNbUtWYFx7n6wDLcFEx45ivE0_XjcbkyVrzPstORYwug8mGtd-zvyvxJI4spEVUpDsiOjkz1zmx1ux9nyo_5uHuidE7s1c3-uFLqnO_B_CBPBO7MPhPD_cDAsgKhRxoyT8uYWlt4v5ebcm6Xbn091yE Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 11 06:13:08.777904 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012dc5fde7946fd8e0315757e7c83bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}] Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Id: 036a3b5a91854a7885a36c160356c884 Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: method: Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: exception: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae'} Sep 11 06:13:08.779354 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. (HTTP 404) (Request-ID: req-b80b7dad-fafc-4f75-96df-b0e2b4dffa9b) Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.780225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 06:13:08.781718 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 06:13:08.783053 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-365a4bdf-b514-4955-a213-8888d6a3a605 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Returning 404 to user: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:13:08.784473 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-365a4bdf-b514-4955-a213-8888d6a3a605 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 404 len: 109 microversion: 2.1 time: 0.209881 Sep 11 06:13:08.785652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2205/4177] 10.222.0.33 () {58 vars in 1248 bytes} [Sun Sep 11 06:13:08 2022] DELETE /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:13:08.791673 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a0c34dd-74c3-439d-b3fb-5da323724825 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Calling method '.version_select at 0x7f2c3ff7de50>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:08.822159 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-2a0c34dd-74c3-439d-b3fb-5da323724825 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] HTTP exception thrown: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a0c34dd-74c3-439d-b3fb-5da323724825 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Request method failure captured: Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae HTTP/1.1 Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXxraS8VAUSTqEB4C_uMk02BGNbUtWYFx7n6wDLcFEx45ivE0_XjcbkyVrzPstORYwug8mGtd-zvyvxJI4spEVUpDsiOjkz1zmx1ux9nyo_5uHuidE7s1c3-uFLqnO_B_CBPBO7MPhPD_cDAsgKhRxoyT8uYWlt4v5ebcm6Xbn091yE Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:13:08.824140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012dc5fde7946fd8e0315757e7c83bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012dc5fde7946fd8e0315757e7c83bb"}]}] Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 8012dc5fde7946fd8e0315757e7c83bb Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-847783640 Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 036a3b5a91854a7885a36c160356c884 Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesSnapshotsTestJSON-847783640-project Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae'} Sep 11 06:13:08.825454 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. (HTTP 404) (Request-ID: req-9d34c201-16d4-4aec-911b-119d7086a221) Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.826810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 06:13:08.828127 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 06:13:08.829239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a0c34dd-74c3-439d-b3fb-5da323724825 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] Returning 404 to user: Volume 2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a0c34dd-74c3-439d-b3fb-5da323724825 tempest-VolumesSnapshotsTestJSON-847783640 tempest-VolumesSnapshotsTestJSON-847783640-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae" status: 404 len: 109 microversion: 2.1 time: 0.038810 Sep 11 06:13:08.830349 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1973/4178] 10.222.0.33 () {58 vars in 1245 bytes} [Sun Sep 11 06:13:08 2022] GET /compute/v2.1/os-volumes/2ce4d15e-0a9f-4d40-9cd3-6bc8e49028ae => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:13:54.759614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:13:54.760526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:54.768528 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:54.769007 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:54.769446 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:54.770154 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:54.770652 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:54.771060 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:54.795193 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lazy-loading 'flavor' on Instance uuid e90563f7-eb6e-49cd-9352-10449646f758 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:13:54.869971 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a370523-5ccb-417c-a5fa-d0619b8ff5ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "POST /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758/action" status: 202 len: 0 microversion: 2.1 time: 0.115677 Sep 11 06:13:54.870576 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2206/4179] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 06:13:54 2022] POST /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:13:54.883071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:54.883857 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:54.891810 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:54.892308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:54.892978 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:54.893763 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:54.894221 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:54.894648 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:55.036578 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:13:55.044360 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b44b8897-6751-4cfb-a264-092045a95e99 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.169132 Sep 11 06:13:55.044907 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1974/4180] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:13:54 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:13:56.069744 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:56.070565 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:56.077440 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:56.077930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:56.078371 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:56.079073 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:56.079509 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:56.079931 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:56.221793 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:13:56.230017 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-458518b9-0598-4bd8-a5bb-1107f1389a5a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.164939 Sep 11 06:13:56.230768 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2207/4181] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:13:56 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:13:57.253530 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:57.254153 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:57.260517 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:57.260999 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:57.261435 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:57.262121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:57.262579 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:57.263001 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:57.396467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:13:57.404919 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d737d16-b0f5-4d0b-8462-9b6f9454ac61 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.154729 Sep 11 06:13:57.405489 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1975/4182] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:13:57 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:13:58.428358 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:58.428999 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:58.436590 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:58.437080 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:58.437524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:58.438221 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:58.438675 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:58.439100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:58.573577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:13:58.582203 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc4b693d-682f-4453-a7d5-5dffa341809d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.157765 Sep 11 06:13:58.582794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2208/4183] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:13:58 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:13:59.609827 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:13:59.610904 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:13:59.617861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:59.618667 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:59.619201 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:59.620756 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:13:59.621548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:13:59.622121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:13:59.771589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:13:59.780398 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d969e3e-4da2-46ac-b000-bbdfcc7ddedc tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.174786 Sep 11 06:13:59.781071 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1976/4184] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:13:59 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:00.807490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:00.808547 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:00.817612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:00.818124 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:00.818753 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:00.819626 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:00.820128 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:00.820527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:00.972400 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:00.981646 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed103b14-83cf-45a6-8b67-a9fded821ea9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.179567 Sep 11 06:14:00.986194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2209/4185] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:00 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:02.006121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:02.006838 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:02.015287 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:02.015867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:02.017821 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:02.018607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:02.019193 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:02.019839 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:02.164823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:02.175585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-920fbb3b-c6f2-4e21-abce-5f86310f4652 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.173843 Sep 11 06:14:02.176654 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1977/4186] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:02 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:03.200664 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:03.202132 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:03.209941 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:03.210465 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:03.210674 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:03.211451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:03.212313 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:03.212748 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:03.365478 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:03.375178 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-458d8032-34b0-4d26-a866-2c405127924b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.178746 Sep 11 06:14:03.375978 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2210/4187] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:03 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:04.400841 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:04.401449 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:04.408048 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:04.408534 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:04.408964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:04.409655 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:04.410106 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:04.410521 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:04.552853 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:04.560867 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-981708a7-c50a-4d28-ac64-9f4ef6f26db8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.165955 Sep 11 06:14:04.561403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1978/4188] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:04 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:05.584427 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:05.585079 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:05.591693 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:05.592557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:05.593058 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:05.593952 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:05.594404 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:05.594826 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:05.739702 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:05.748666 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da5e1cce-d2a0-4c40-80a2-9cd20cf5f8bf tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.168333 Sep 11 06:14:05.749235 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2211/4189] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:05 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:06.772353 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:06.772961 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:06.780906 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:06.781548 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:06.781991 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:06.782688 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:06.783172 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:06.783599 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:06.914831 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:06.924239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49dae329-65e4-4416-975a-ebd79b88a4df tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.154743 Sep 11 06:14:06.924239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1979/4190] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:06 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:07.946896 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:07.948288 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:07.956600 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:07.957086 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:07.957523 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:07.958216 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:07.958730 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:07.959070 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:08.099492 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:08.108659 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9f99242-dd2f-40d4-98af-7580eb9bab03 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.165785 Sep 11 06:14:08.109307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2212/4191] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:07 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:09.132683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:09.133297 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:09.140290 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:09.141095 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:09.141687 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:09.142495 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:09.143140 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:09.143802 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:09.473984 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:09.482046 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12e76b0d-221b-4c94-9407-ef672c1e425b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.353013 Sep 11 06:14:09.483293 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1980/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:09 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:10.508961 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:10.510301 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:10.519421 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:10.520325 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:10.520924 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:10.521773 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:10.522388 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:10.523024 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:10.811042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:10.820645 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94288104-577d-49e0-b9ac-3c682783ac31 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.318001 Sep 11 06:14:10.836552 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2213/4193] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:10 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:11.845459 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:11.846671 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:11.853467 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:11.853960 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:11.854623 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:11.855505 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:11.855966 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:11.856709 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:12.003051 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:12.015493 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d9e2c5e-8f62-4bbd-8e24-9a2a513c9949 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.174586 Sep 11 06:14:12.024617 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1981/4194] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:11 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:13.049277 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:13.050061 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:13.058120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.059505 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.060217 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.061206 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.061678 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.062286 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.279930 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:13.289106 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-890c64cc-8761-4791-971e-38650080335c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1569 microversion: 2.1 time: 0.246151 Sep 11 06:14:13.290194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2214/4195] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:13 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:13.312261 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:14:13.312854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:13.319664 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.320191 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.320633 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.321318 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.321994 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.322601 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.494277 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120644) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 06:14:13.577239 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8849d26-3990-4fc3-9ada-0e6abd4e77a9 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "POST /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758/action" status: 202 len: 0 microversion: 2.1 time: 0.269307 Sep 11 06:14:13.578055 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1982/4196] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Sep 11 06:14:13 2022] POST /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 06:14:13.586179 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:13.586866 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:13.593491 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.594037 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.594688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.595596 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:13.596171 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:13.596656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:13.744557 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:13.753278 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a63d2c7f-6506-43c0-8a6c-d748ec00f8f8 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1517 microversion: 2.1 time: 0.170967 Sep 11 06:14:13.754105 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2215/4197] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:13 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:14.789337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:14.789337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:14.789337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:14.789337 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:14.790434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:14.790434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:14.790434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:14.790434 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:14.936980 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:14.945085 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81651d21-3ad3-40e2-932a-812aa025c5e5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1519 microversion: 2.1 time: 0.171047 Sep 11 06:14:14.951636 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1983/4198] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:14 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:15.983526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:15.984806 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:15.992092 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:15.993616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:15.994264 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:15.994990 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:15.995457 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:15.996476 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:16.254131 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:16.262020 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-81a95502-c0ee-4b31-b407-275d9fe877ab tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.282976 Sep 11 06:14:16.262599 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2216/4199] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:15 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:16.721413 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "name": "network-vif-unplugged", "status": "completed", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:14:16.734255 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:16.734877 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:16.735375 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:16.747736 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] Creating event network-vif-unplugged:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:14:16.753342 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-acfbb301-7bbc-4521-90ab-0edab00c922d req-629e3010-b4cf-4f56-ab9d-6be118694d11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113465 Sep 11 06:14:16.754045 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1984/4200] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:14:17.288848 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:17.289641 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:17.296869 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:17.297680 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:17.298342 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:17.299127 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:17.299661 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:17.300199 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:17.602677 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:17.612346 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77a463db-8e47-4750-b574-650f2a708617 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.327470 Sep 11 06:14:17.613330 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2217/4201] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:17 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:18.643439 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:18.646228 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:18.657283 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:18.658115 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:18.658715 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:18.659798 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:18.660616 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:18.661264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:18.844823 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:18.853714 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a08e32ae-b0f5-470c-9906-acb77c97c548 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.219197 Sep 11 06:14:18.872656 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1985/4202] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:18 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:19.879849 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:19.880713 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:19.887280 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:19.887853 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:19.888577 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:19.889614 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:19.890225 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:19.890915 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:20.041210 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:20.052109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef3dee44-c592-4aeb-ba63-0aebc7121add tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.177001 Sep 11 06:14:20.053054 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2218/4203] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:19 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:21.076546 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:21.077203 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:21.083854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:21.084384 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:21.084826 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:21.085558 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:21.086020 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:21.086450 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:21.227194 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:21.235383 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba063e07-a670-4bd8-b89b-a3c0caed3a7d tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.163393 Sep 11 06:14:21.235948 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1986/4204] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:21 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:22.258929 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:22.259656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:22.266649 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:22.267142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:22.267580 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:22.268307 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:22.268766 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:22.269198 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:22.420799 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:22.428653 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a9c277c-3eb3-4c3e-b491-9e8000735dc6 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.173575 Sep 11 06:14:22.429418 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2219/4205] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:22 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:23.453084 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:23.453833 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:23.460249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:23.460733 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:23.461170 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:23.461864 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:23.462320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:23.462751 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:23.594716 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:23.602690 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bafee9ec-0598-40e8-9fe2-c0b1b821585b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.154075 Sep 11 06:14:23.603286 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1987/4206] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:23 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:24.626582 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:24.627195 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:24.633688 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:24.634173 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:24.634612 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:24.635304 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:24.635763 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:24.636222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:24.655194 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:14:24.770776 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:24.779527 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5d9768f-1b0b-4c61-be29-50a2b1b55da2 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.156689 Sep 11 06:14:24.780120 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2220/4207] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:24 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:25.802882 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:25.803626 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:25.806062 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:14:25.811874 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:25.812403 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:25.812851 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:25.813564 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:25.814025 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:25.814457 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:25.817880 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:14:25.955289 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:25.963397 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bcdfd56a-4649-4f1a-8b0c-88c1e4d83b81 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.164448 Sep 11 06:14:25.963971 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1988/4208] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:25 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:26.987441 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:26.987968 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:26.990425 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=31 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:14:26.995759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:26.996273 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:26.996709 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:26.998102 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:26.998790 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:26.999218 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:27.135967 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:27.145164 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01106b70-585c-48f0-8b1e-c8423455748f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.161679 Sep 11 06:14:27.145923 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2221/4209] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:26 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:28.170683 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:28.171299 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:28.177761 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:28.178248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:28.178693 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:28.179393 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:28.179854 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:28.180309 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:28.317002 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:28.325197 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f2b9f631-fae2-462d-b5ac-0a01b256d64f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.158447 Sep 11 06:14:28.326320 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1989/4210] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:28 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:29.351112 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:29.351726 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:29.359390 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:29.359879 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:29.360338 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:29.361042 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:29.361490 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:29.361908 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:29.511616 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:29.520420 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b8f831e-968d-4d0a-86fc-ba4589371f7c tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1575 microversion: 2.1 time: 0.174131 Sep 11 06:14:29.521222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2222/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:29 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:30.554394 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:14:30.555033 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:14:30.558421 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:14:30.558585 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Sun Sep 11 06:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 (ip 10.222.0.33) !!! Sep 11 06:14:30.566632 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:30.567121 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:30.567589 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:30.568324 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:30.568785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:30.569215 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:30.759036 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:14:30.767792 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d2535d5-2cf6-4662-9a23-41535b63d177 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1562 microversion: 2.1 time: 0.223539 Sep 11 06:14:30.768590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1990/4212] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:14:30 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:14:32.757548 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "name": "network-vif-plugged", "status": "completed", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:14:32.769787 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:14:32.770767 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:14:32.771370 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:14:32.786403 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] Creating event network-vif-plugged:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:14:32.795219 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1a21aefe-dcf4-4c79-a7b9-b802b4697677 req-278ed886-5cd9-482f-8594-750f91b15b70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040881 Sep 11 06:14:32.796297 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2223/4213] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:16:08.271963 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:16:08.272643 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 11 06:16:08.273262 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:08.274542 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 06:16:08.274662 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: Sun Sep 11 06:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 11 06:16:08.275041 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:08.276322 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=5 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:16:08.277068 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=16 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:16:08.283492 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ae98b5f-4f1a-4fb2-a6d3-b33b0404baae] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 11 06:16:08.284351 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=5 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:16:08.285075 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=17 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 06:16:08.286624 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:08.287119 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:08.287566 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:08.288308 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:08.288785 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:08.288943 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:16:08.289264 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:08.321524 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:08.321754 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 06:16:08.322023 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:08.322434 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:08.334414 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] Creating event network-changed:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:16:08.340115 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-571e0bdd-396d-43a6-9e3c-4301ec00a22c req-120a85f2-e633-4af9-bc41-51ca84508efb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070117 Sep 11 06:16:08.340719 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2224/4214] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 06:16:08.427602 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f288c63-1809-46d7-a077-893149077487 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 204 len: 0 microversion: 2.1 time: 0.160991 Sep 11 06:16:08.429000 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1991/4215] 10.222.0.33 () {58 vars in 1239 bytes} [Sun Sep 11 06:16:08 2022] DELETE /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 06:16:08.437986 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:08.439226 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:08.447224 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:08.449109 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:08.455100 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:08.456310 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:08.456803 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:08.457514 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:08.614864 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:16:08.622871 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ba68ebe-fd07-463b-8fd3-5a444e2e7778 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.189253 Sep 11 06:16:08.632977 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2225/4216] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:16:08 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:16:09.646461 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:09.647160 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:09.657250 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:09.657927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:09.658363 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:09.659087 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:09.659544 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:09.659964 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:09.667088 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ae98b5f-4f1a-4fb2-a6d3-b33b0404baae] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41490. Sep 11 06:16:09.812728 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:16:09.821138 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-235ac330-7084-40ce-a411-77ea03944ed5 tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1568 microversion: 2.1 time: 0.178949 Sep 11 06:16:09.822083 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1992/4217] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:16:09 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:16:10.844969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:10.846222 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:10.853041 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:10.853759 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:10.854204 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:10.855097 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:10.855743 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:10.856357 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:11.047289 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:16:11.055351 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adb59781-80a7-4af9-ba81-b595191e6c9a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1450 microversion: 2.1 time: 0.214320 Sep 11 06:16:11.056056 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2226/4218] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:16:10 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1450 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:16:11.133590 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90563f7-eb6e-49cd-9352-10449646f758", "name": "network-vif-deleted", "tag": "6a07eb0d-c450-4418-9925-f2ac84885173"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 06:16:11.148269 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:11.148743 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:11.149433 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:11.163927 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] Creating event network-vif-deleted:6a07eb0d-c450-4418-9925-f2ac84885173 for instance e90563f7-eb6e-49cd-9352-10449646f758 on hv-cinder-85692 Sep 11 06:16:11.170396 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b1b8030d-62cc-4e50-8337-838b15edb291 req-ac89c343-9735-47db-9c1f-fe3a1903d670 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039829 Sep 11 06:16:11.171511 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1993/4219] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Sep 11 06:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 06:16:12.082794 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:12.084142 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:12.090451 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:12.090969 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:12.092585 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:12.093512 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:12.094149 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:12.094589 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:12.130754 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:12.131243 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:12.131681 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:12.132444 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lazy-loading 'fault' on Instance uuid e90563f7-eb6e-49cd-9352-10449646f758 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 06:16:12.183464 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309d1efd676845bbaa30f472b19ffa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10427ce4a1644db89943273919d296cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 06:16:12.192526 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a76c630f-b17b-4893-982c-3f5820ce776a tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 200 len: 1224 microversion: 2.1 time: 0.117054 Sep 11 06:16:12.193285 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2227/4220] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:16:12 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 06:16:13.218249 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:13.219064 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] [instance: e90563f7-eb6e-49cd-9352-10449646f758] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 06:16:13.225762 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:13.226414 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:13.226939 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:13.227691 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Acquiring lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 06:16:13.228240 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 06:16:13.228726 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Lock "cf3f0c85-0dae-4d22-94ea-a598ee9fea69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 06:16:13.242603 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] HTTP exception thrown: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Request method failure captured: Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 HTTP/1.1 Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.33 Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjHXvqKa2XjbcIZSvGbX8WCLJW4fajLOzvT_5N91HaUnxE4FX_OYpH4Z7HllnApCfbZHDJUF8nMpZbJdTTYekwUKcjCdo1eHdQbUWln8ENKhETz6N_Uq3S4Sbg2ni09HwiSXp40zsMXdwz4VvnsTDyT0-1GssiQ-fwynxf_SDuasu6bcs Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 10427ce4a1644db89943273919d296cc Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-TestShelveInstance-2147108840 Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 11 06:16:13.244248 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10427ce4a1644db89943273919d296cc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10427ce4a1644db89943273919d296cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10427ce4a1644db89943273919d296cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10427ce4a1644db89943273919d296cc"}]}] Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-TestShelveInstance-2147108840 Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 10427ce4a1644db89943273919d296cc Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-TestShelveInstance-2147108840 Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User: tempest-TestShelveInstance-2147108840-project Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Id: 309d1efd676845bbaa30f472b19ffa34 Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-TestShelveInstance-2147108840-project Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: method: > Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: exception: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. Sep 11 06:16:13.245861 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'e90563f7-eb6e-49cd-9352-10449646f758'} Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 06:16:13.246886 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. Sep 11 06:16:13.248484 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 11 06:16:13.249607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Returning 404 to user: Instance e90563f7-eb6e-49cd-9352-10449646f758 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 06:16:13.249607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b1d0e783-273a-4dbd-97e2-641282e1662f tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758" status: 404 len: 111 microversion: 2.1 time: 0.032355 Sep 11 06:16:13.249607 dv-cinder-856921-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1994/4221] 10.222.0.33 () {58 vars in 1236 bytes} [Sun Sep 11 06:16:13 2022] GET /compute/v2.1/servers/e90563f7-eb6e-49cd-9352-10449646f758 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 06:16:13.406136 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-caa1e77c-b9f6-437c-8893-b257fabfad3b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] Calling method '.version_select at 0x7f2c3f1075e0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 06:16:13.442656 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-caa1e77c-b9f6-437c-8893-b257fabfad3b tempest-TestShelveInstance-2147108840 tempest-TestShelveInstance-2147108840-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005527364" status: 202 len: 0 microversion: 2.1 time: 0.040922 Sep 11 06:16:13.443214 dv-cinder-856921-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2228/4222] 10.222.0.33 () {58 vars in 1254 bytes} [Sun Sep 11 06:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005527364 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)